An image encoding / decoding method, an image encoding / decoding apparatus, and an image encoding /

专利摘要:
SUMMARY OF THE INVENTION An object of the present invention is to provide an encoding device and an encoding method capable of efficiently encoding both of a pixel value signal and an image signal including a shape signal for processing. The predictive converter outputs the reference pixel value switching signal and the reference shape switching signal to the switch circuit to be selected and the switch circuit to select the reference shape signal, respectively, to control to select an appropriate reference signal.
公开号:KR19980070825A
申请号:KR1019980002217
申请日:1998-01-24
公开日:1998-10-26
发明作者:카도노신야
申请人:모리시타요우이치；마쓰시타덴키산교가부시끼가이샤；
IPC主号:

专利说明:

An image encoding / decoding method, an image encoding / decoding apparatus, and an image encoding / decoding program recording medium
The present invention relates to an image encoding / decoding method, an image encoding / decoding apparatus, and an image encoding / decoding program recording medium. In particular, in order to efficiently handle image signals on an object basis, an image signal having shape information of an object can be used. A picture coding process for recording and transmitting without compromising image quality with a smaller number of bits, and a picture decoding process for appropriately decoding the result of the coding.
BACKGROUND ART A technique for digitalizing an image to obtain digital image data is easy to handle in recording, transferring, editing, copying, and transferring digital data, and thus, the spread and development of the image is remarkable. One of the advantages of digitalization is that data can be easily compressed, and compression coding is an important technique, especially for recording and transmission. The international standard is also established about such a compression coding technique, and the MPEG standard is spread as a general digital standard which can handle a video and audio.
In compression coding of a digital image, image data consisting of a series of still images in which the image is digitalized is used as a processing target. Generally, in compression coding, a still picture of one frame (equivalent to one screen) is compressed by removing redundancy based on its spatial correlation (correlation in a frame). Intra-frame coding and inter-frame that perform compression by removing redundancy based on the temporal correlation (correlation between frames) for still images of temporally adjacent frames, for example, temporally continuous frames. Inter frame coding is performed.
In the conventional image coding according to MPEG or the like, basically, intra-frame coding is performed. However, by performing inter-frame coding, encoded data having a high compression ratio is obtained. In order to perform inter-frame encoding, a prediction image is generated by performing decoding processing, which is a reverse process of encoding, or motion detection / motion compensation processing, and using the predictive image as a reference image, a difference from the encoding target image is obtained. As a result, the processing burden on the apparatus is increased as much as decoding, motion detection and compensation processing are required. However, when the accuracy of the predictive image is good, the difference is small, so that encoding efficiency can be improved by encoding the difference, rather than encoding the encoding target image itself.
As for the prediction method in the case of performing inter-frame coding, forward prediction based on data located in time series before data to be encoded in a series of still images, and backward prediction based on data located later , And bidirectionally prediction based on data located in the forward or backward direction. In general, intraframe coding is denoted by "I" (intra frame coding), forward predictive coding is "P" (predictive coding), and bidirectional predictive coding (including reverse direction) is denoted as "B" (bidirectionally predictive coding). .
When only intra-frame encoding is performed or when intra-frame encoding and forward predictive encoding are performed, a series of still images to be encoded may be simply processed according to time series. However, when reverse or bidirectional prediction is performed, There is a need to first encode data to be located later. Therefore, in general, when inter-frame coding is also performed, each frame constituting the image data to be encoded can be an I frame for intra-frame coding, a P frame capable of forward predictive coding, or bi-directional predictive coding. If the data to be processed is an I frame, intra-frame coding is performed. If the data to be processed is a P frame or a B frame, intra-frame coding or inter-frame coding is performed. In the case of performing such an encoding process, in the encoding apparatus, the ratio of I frames, P frames, and B frames can be set according to the use of the encoding result or the like.
It is a figure for demonstrating the intra-frame and the inter-frame coding process by a prior art. In the same figure, (1400-1406) is image data for each frame constituting the image data to be encoded, each time is t0 to t6, and the times t0 to t6 have time series in this order. Of the frames 1400-1406, frame 1400 is an I frame, frame 1403, and frame 1406 are P frames, and frames 1401, 1402, 1404, and 1405 are B frames.
The arrow shown shows the reference relationship in the coding process for every frame. The frame 1400, which is an I frame, is independently intraframe encoded without referring to another frame. The frame 1403, which is a P frame, can be encoded by referring to a frame 1400 located before the time series. The frame 1401, which is a B frame, can be encoded by referring to any one or both of the frame 1400 located in time series and the frame 1403 located in time series.
For this reason, as described above, the frame 1403 needs to be coded before the frame 1401 or the frame 1402 positioned before in time series, so that the I frame or the P frame is given priority over the B frame. First, we code. Neither frame is encoded with reference to the B frame.
In the case of performing the encoding process by performing bidirectional prediction, in the encoding process for the B frame, inter-frame encoding is performed by referring to the preceding and following frames, or the inter-frame encoding is performed by selecting a reference frame among the previous frame, the next frame, and both frames. Can be set in the encoding apparatus, or added at the time of selecting intra-frame encoding.
As described above, the inter-frame encoding is accompanied by an increase in processing burden, especially when bidirectional prediction is also performed, and a storage means for holding data that is close in time, that is, a large memory is also known. It is necessary. However, by making a highly accurate prediction, the amount of difference between the predicted image obtained by the prediction and the encoding target image is small, and the coding efficiency can be improved. Therefore, the encoding method has been set according to the device performance, the nature of the image, the quality of the encoded data required, and the like.
On the other hand, a method of encoding an image signal in units of objects has also been recently generalized. This coding method is currently standardized in ISO MPEG4, and in November 1996, the video verification model VM5.0 was devised. The image signal in units of objects is composed of a pixel value signal indicating luminance or color and a shape signal indicating the shape of an object called a texture. This type of image signal is used in the field of creating a video source, such as a program production section, mainly in the field of computer graphics.
FIG. 15 is a diagram for explaining encoding of an object unit according to the prior art, and FIG. 16 is a diagram for explaining signal processing for encoding of an object unit. FIG. 15A illustrates an example of an image composed of a background image and a foreground image (a goldfish swimming in a tank) as an example of an encoding process object, and FIG. 15B illustrates a foreground image (a goldfish). In addition, Fig. 15C shows a background image (water plants and water in the tank).
In order to synthesize such a background image and a foreground image, information for specifying which image of the foreground and background is to be displayed for each pixel constituting the image obtained by the synthesis. For this reason, the foreground image shown in Fig. 15B is composed of a pixel value signal shown in Fig. 16A and a binary alpha signal shown in Fig. 16B. It is assumed that image display is specified in the shape signal. The pixel value signal in this case is a signal representing the texture of the goldfish and includes a luminance signal and a color difference signal of each pixel. The shape signal is a signal representing a profile which is a shape contour of a goldfish, and is a binary signal having a value "1" inside the outline and a value "0" outside the outline. This shape signal is a signal which shows to display as a foreground at the time of image synthesis about the area | region which becomes the value "1" shown with the black part in a figure. In general, in the case of encoding in units of objects, the pixel value signal and the shape signal are used for a specific object, and only the pixel value signal is used for a portion other than the specific object, so that efficient encoding processing can be achieved. Will be. As described above, in this case, the goldfish serving as the foreground image is treated as a specific object.
As for the encoding of the pixel value signal shown in Fig. 16A, the encoding efficiency is improved by referring to a signal obtained by decoding the already encoded pixel value signal based on the temporal correlation as described above. This is planned. In addition, by encoding two images adaptively and referring to them, an encoding method that makes coding efficiency higher than referring to the pixel value signal of one image is also used. In the standards of ITU-T H.261 and the like, provisions are made for the encoding of these two pictures.
17 and 18 are diagrams for explaining the encoding of the pixel value signal with reference to such a plurality of images. Fig. 17 shows pixel value signals of an input image at (a) time t0, (b) time t1, and (c) time t2 constituting the foreground image. As shown, the three input pixel value signals are located side by side on one time series as in the case of FIG. 14, and the signal at time t0 is located before the signal at time t1 in time series, and the signal at time t2. Is located later in time series than the signal at time t1. The pixel value signal of the input image at time t1 shown in FIG. 17B is the pixel value signal at the previous time t0 shown in FIG. 17A, and the pixel value at the time t2 shown in FIG. 17C. Correlated with the signal.
18A and 18C show a decoded pixel value signal obtained by encoding and decoding the pixel value signals shown in FIGS. 17A and 17C. Based on the correlation shown in FIG. 17, the time shown to FIG. 18B using the pixel value signal of the decoded image of time t0 and time t2 shown to FIG. 18 (a) and FIG. 18 (c). A predictive image of t1 can be generated with high precision.
According to the typical method, the predicted image can be generated by motion-compensating the decoded images at time t0 and time t2, respectively, and using their average values as predicted images at time t1. Since the predicted image at time t1 has a great correlation with the input image at time t1, the input image at time t1 is encoded by referring to the predicted image at time t1. In other words, the difference image between the predicted image generated based on the image located before and after in time series and the input image is acquired, and the pixel value signal of the difference image is encoded.
As described above, when the image to be encoded has a strong correlation with the image located before and after in time series, the image placed before in time series and the image located after in time series are used for generation of the predictive image. It can be expected to be able to make a more accurate prediction than using either. If the precision of the prediction is good, the pixel value signal of the differential image has a small data amount, so that efficient encoding is realized.
As described above, when encoding in units of objects, as described above, for the pixel value signal, it is possible to improve the coding efficiency based on the temporal correlation. On the other hand, the encoding of the shape signal accompanying this can be handled similarly to the pixel value signal when only intra-frame encoding or inter-frame encoding with only forward prediction is performed. However, in the case of performing interframe encoding with bidirectional prediction, the problem has been that the efficiency of the process is lowered by performing the same processing as that of the pixel value signal in the encoding process of the shape signal.
Since the pixel value signal is a multi-valued signal including a luminance signal and a color signal, it is highly likely to obtain a good predictive image by the above-described calculation of the average value. It is possible to improve the coding efficiency by performing arithmetic processing of average value acquisition. In contrast, in the case of using the binary signal as described above, when the average value is obtained by using a plurality of reference information, for example, to obtain good prediction, the obtained average value does not correspond to any of the binary values. In this case, there is little advantage in performing arithmetic processing to obtain an average value. In general, for shape signals that are binary signals, the accuracy of prediction may not necessarily be improved by processing data such as obtaining an average value by maintaining data that is close in time, thereby preventing utilization of device resources or encoding. In some cases, the efficiency in the treatment may be lowered.
In the image coding according to the prior art, when processing the pixel value signal and the shape signal in the same manner, the problem of the efficiency of the processing as described above has been a problem in the encoding process involving bidirectional prediction. In addition, the method of improving the coding efficiency of the pixel value signal is difficult to be applied in this way, and therefore, in the prior art, the shape value is used in the reversible compression coding method for binary signals used in facsimile or the like. In some cases, the data may be processed separately from the signal and recorded or transmitted. However, such a reversible method is generally inferior in compression efficiency to that of the irreversible method, and it is not possible to improve the coding efficiency and the processing efficiency very much.
SUMMARY OF THE INVENTION An object of the present invention has been made in view of such circumstances, and in encoding the pixel value signal and the image signal including the shape signal, the encoding with reference is performed so that any of the pixel value signal and the shape signal can be obtained. The present invention provides an image coding method that can improve coding efficiency.
Further, an object of the present invention is to perform encoding with reference in encoding a pixel value signal and an image signal including a shape signal, thereby improving the coding efficiency of either the pixel value signal or the shape signal. The present invention provides a picture coding apparatus that can be designed.
It is also an object of the present invention to provide an image decoding method which can appropriately perform a decoding process on an encoding result efficiently encoded by the above-described image encoding method.
It is also an object of the present invention to provide an image decoding apparatus capable of appropriately decoding processing on an encoding result efficiently encoded by the image encoding apparatus.
Further, an object of the present invention is to perform encoding with reference in encoding a pixel value signal and an image signal including a shape signal, thereby improving the coding efficiency of either the pixel value signal or the shape signal. The present invention provides a recording medium on which an image coding program can be designed.
It is also an object of the present invention to provide a recording medium on which an image decoding program capable of performing appropriate decoding processing on an encoding result efficiently encoded by execution of the above image encoding program is recorded.
1 is a block diagram showing the structure of a picture coding apparatus according to a first embodiment of the present invention;
2 is a diagram for explaining a shape signal encoding process in the same embodiment;
3 is a block diagram showing the structure of a picture decoding apparatus according to a second embodiment of the present invention;
4 is a diagram for explaining code assignment of prediction selection signal generation processing in Embodiment 3 of the present invention;
5 is a diagram for explaining code assignment of prediction selection signal generation processing in Embodiment 4 of the present invention;
6 is a diagram for explaining code assignment of prediction selection signal generation processing in Embodiment 5 of the present invention;
7 is a diagram for explaining a switching unit of encoding processing in a ninth embodiment of the present invention;
8 is a diagram for explaining a switching unit of shape signal encoding processing in a tenth embodiment of the present invention;
9 is a diagram for explaining a reference relationship of encoding processing in a thirteenth embodiment of the present invention;
10 is a flowchart showing a processing procedure of an encoding process for a B frame in the same embodiment;
11 is a flowchart showing a processing procedure of encoding control by a predictive switcher in the same embodiment;
12 is a flowchart showing the processing procedure of the decoding process for the B frame in the image decoding device according to the sixteenth embodiment of the present invention;
FIG. 13 shows a floppy disk which can be used as a picture coding program recording medium and a picture decoding program recording medium according to Embodiments 19 and 20 of the present invention; FIG.
14 is a diagram for explaining an image encoding process based on a temporal correlation according to the prior art;
FIG. 15 is a diagram for explaining image coding processing in units of objects according to the prior art; FIG.
FIG. 16 is a diagram for explaining a pixel value signal and a shape signal used in an image coding process of an object unit according to the prior art; FIG.
FIG. 17 is a diagram for explaining the temporal correlation of pixel value signals in an image coding process in units of objects according to the prior art; FIG.
FIG. 18 is a diagram for explaining an image coding process based on a temporal correlation with respect to a pixel value signal in an object coding unit according to the prior art; FIG.
Explanation of symbols for the main parts of the drawings
101: subtractor 102, 111: encoder
103, 112: decoder 104: adder
105, 106, 113, 114: switch circuit 107, 108, 115, 116: memory
109: Average Calculator 110: Predictive Conversion
In order to achieve this object, the prediction processing is adapted to the characteristics of the shape signal by controlling the selection of the reference object in the prediction process based on temporal correlation independently of the pixel value signal coding for the shape signal coding. I got the idea of doing.
In order to achieve the above object, the image encoding method according to claim 1 of the present invention encodes an input image signal including a shape signal representing the shape of an object and a pixel value signal having information on the color and luminance of the object. A picture encoding method for processing comprising: a pixel value encoding step of encoding a pixel value signal included in the input image signal as a processing target by referring to a decoded pixel value signal obtained by decoding after a coding process; and the input image A shape encoding step of encoding a shape signal included in the signal as a processing target by referring to a decoded shape signal obtained by decoding after the encoding process, and a reference to designate a decoded pixel value signal referred to in the pixel value encoding step. Pixel value designation signal and reference in the shape coding step Includes a coded reference specific signal generation step of generating a reference shape designation signal specifying a decoded shape signal, and generating a prediction selection signal including information indicating a reference method in coding based on the generated signal will be. Accordingly, in the pixel value signal encoding step and the shape signal encoding step, encoding involving reference to the selected reference signal is executed.
In the method of claim 1, in the method of claim 1, the shape coding step includes a display angle decoded shape signal obtained from a shape signal previously located in time series with respect to the shape signal to be processed. With respect to the shape signal to be processed, the rear-view decoded shape signal obtained from the shape signal located later in time series is used as the decoded shape signal referred to above. As a result, the shape signal is encoded using a correlation with a signal having a temporal proximity.
In the method of encoding an image according to claim 3, in the method of claim 2, the pixel value encoding step includes display angle decoding obtained from a pixel value signal previously located in time series with respect to the pixel value signal to be processed. With respect to the pixel value signal and the pixel value signal to be processed, the rear-view decoded pixel value signal obtained from the pixel value signal located later in time series is used as the decoded pixel value signal referred to above. As a result, the encoding process is performed by using the correlation between the shape signal and the pixel value signal in close proximity to each other.
In the method of claim 1, in the method of claim 1, the coded reference specifying signal generation step includes generating the reference selection signal and the reference shape specifying signal in the generation of the prediction selection signal. It is integrated and encoded. Accordingly, a short code length is assigned to a phenomenon with a high frequency to generate a prediction selection signal.
In the method of claim 1, in the method of claim 1, the encoding reference specifying signal generating step corresponds to a method indicating designation of the decoded shape signal to be referred to in the generation of the prediction selection signal. The method for indicating the designation of the decoded pixel value signal referred to above is determined. Accordingly, a short code length is assigned to a phenomenon with a high frequency to generate a prediction selection signal.
In the method of encoding an image according to claim 6, in the method of claim 1, the encoding reference specifying signal specifying step designates the reference decoded pixel value signal for each pixel value switching unit that is a unit of the input pixel value signal. The reference shape signal is specified for each shape switching unit that is a unit of the shape signal to be input. As a result, the encoding process is performed with a lower frequency of switching without significantly reducing the prediction accuracy, corresponding to the shape signal.
In the method according to claim 7, in the method of claim 6, the shape switching unit is a frame constituting the input shape signal. As a result, by switching the frame unit corresponding to the property of the shape signal, the encoding process is performed while reducing the frequency of switching without greatly reducing the prediction accuracy.
In the method of claim 6, the picture coding method according to claim 8 includes the large block unit constituting the switching signal and the small block constituting the large block unit. It is a hierarchical unit including block units. Accordingly, by performing switching in a hierarchical unit corresponding to the property of the shape signal, the encoding process is performed while reducing the frequency of the switching without greatly reducing the prediction accuracy.
In the method of claim 1, in the method of claim 1, the shape encoding step includes a display angle decoded shape signal obtained from a shape signal previously located in time series with respect to the shape signal to be processed. And a comparison determination step of selecting, from a post-view decoded shape signal obtained from a shape signal located later in time series and closer to the shape signal to be processed, in time, wherein the decoded shape selected in the comparison decision step is included. To refer to the signal. This simplifies the reference processing in the shape signal coding process without significantly reducing the prediction accuracy in accordance with the properties of the shape signal.
The image encoding method according to claim 10 is, in the method of claim 1, wherein the shape encoding step includes a display angle decoded shape signal obtained from a shape signal previously located in time series with respect to the shape signal to be processed. It is for reference. This greatly simplifies the reference processing in the shape signal coding process without significantly reducing the prediction accuracy in accordance with the properties of the shape signal.
The picture coding method according to claim 11 is characterized in that, in the method of claim 1, the shape coding step includes: a display angle decoded shape signal obtained from a shape signal previously located in time series with respect to the shape signal to be processed; A comparison determination step of selecting closer to the shape signal to be processed and more temporally among the post-view decoded shape signals obtained from the shape signals located later in time series, and forward fixation to select the display angle decoded shape signals. Including the step, in the comparison determination step or the forward fixation step, the selected decoded shape signal is referred to. This simplifies by switching the reference process in the shape signal coding process without significantly reducing the prediction accuracy, corresponding to the shape signal.
Further, the image decoding method according to claim 12 includes: a coded shape signal obtained by encoding a shape signal indicating a shape of an object included in an image signal, and a pixel value signal having information on color and luminance of the object; An image decoding method for decoding a coded pixel value signal, wherein the coded pixel value signal is based on information obtained from the predictive selection signal using a prediction selection signal including information indicating a reference method in the coding process. A decode reference specific signal for generating a reference pixel value designation signal for designating a decoded pixel value signal to be referred to in the decoding process for a signal; A generation step and the encoded pixel value signal as a processing target; A pixel value decoding step of performing a decoding process by referring to a specific decoded pixel value signal on the basis of the reference pixel value designation signal generated in the decoded reference specifying signal generation step, and subjecting the encoded shape signal to a processing reference; And a shape decoding step of decoding by referring to the specific decoded shape signal based on the reference shape designation signal generated in the specific signal generation step. Accordingly, in the pixel value signal decoding step and the shape signal decoding step, decoding with appropriate reference is performed respectively.
In the image decoding method according to claim 13, in the method according to claim 12, in the shape decoding step, the angle-of-view decoded shape signal obtained from a shape signal previously located in time series with respect to the coded shape signal to be processed. The back-view decoded shape signal obtained from the shape signal located later in time series is used as the decoded shape signal referred to above. As a result, the decoding process is performed by referring to a signal having a temporally close proximity to the encoded shape signal.
In the image decoding method according to claim 14, in the method according to claim 13, the pixel value decoding step includes a display angle obtained from a pixel value signal previously located in time series with respect to the encoded pixel value signal to be processed. The decoded pixel value signal obtained from the pixel value signal located later in time series with respect to the decoded pixel value signal and the coded pixel value signal to be processed as the decoded pixel value signal referred to above. Accordingly, the decoding process is performed by referring to a signal in which the encoded shape signal and the encoded pixel value signal are close in time.
In the image decoding method according to claim 15, in the method of claim 12, the decoding reference specifying signal generation step includes decoding the prediction selection signal, integrating and encoding the reference pixel value designation signal, and The reference shape designation signal is acquired. Accordingly, short code lengths are assigned to phenomena having a high frequency, and the encoded prediction selection signals are decoded.
The picture decoding method according to claim 16, wherein, in the method according to claim 12, the decoding reference specifying signal generating step corresponds to a method indicating designation of the decoded shape signal to be referred to in the decoding processing of the prediction selection signal. In this way, the method for indicating the designation of the decoded pixel value signal referred to above is determined. Accordingly, short code lengths are assigned to phenomena having a high frequency, and the encoded prediction selection signals are decoded.
Further, in the image decoding method according to claim 17, in the method of claim 12, the decoding reference specifying signal generating step includes specifying the reference decoding pixel value signal for each pixel value switching unit that is a unit of the encoded pixel value signal. The reference shape signal is designated for each shape change unit that is a unit of the coded shape signal. As a result, the encoded shape signal subjected to the encoding process is decoded with a low frequency of switching.
In the image decoding method according to claim 18, in the method according to claim 16, the shape switching unit is a frame constituting the encoded shape signal. As a result, the switching is performed in units of frames, and the decoding frequency is decoded by encoding the encoded shape signal with a small switching frequency.
In the method of claim 16, the picture decoding method according to claim 19 is hierarchical including the switching unit including a large block unit constituting the encoded shape signal and a small block unit constituting the large block unit. It is in units. As a result, the switching is performed in a hierarchical unit, and the decoding frequency is decoded by reducing the switching frequency.
In the image decoding method according to claim 20, in the method according to claim 12, in the shape decoding step, the angle-of-view decoded shape signal obtained from a shape signal that is previously located in time series with respect to the coded shape signal to be processed. And a comparison decision step of selecting one of the post-view decoded shape signals obtained from the shape signals later located in time series and closer to the encoded shape signal to be processed, in time. Reference is made to the decoded shape signal. As a result, the reference processing is simplified to decode the encoded shape signal.
In the image decoding method according to claim 21, in the method according to claim 12, in the shape decoding step, the angle-of-view decoded shape signal obtained from a shape signal previously located in time series with respect to the coded shape signal to be processed. To refer to. As a result, the reference processing is simplified to decode the encoded shape signal.
In the image decoding method according to claim 22, in the method according to claim 12, in the shape decoding step, the angle-of-view decoded shape signal obtained from a shape signal previously located in time series with respect to the coded shape signal to be processed. And a comparison determination step of selecting closer to temporally the encoded shape signal to be processed, among the post-view decoded shape signals obtained from the shape signals later located in time series, and selecting the display angle decoded shape signal. In the comparison determination step, or in the forward lock step, including the forward lock step, reference is made to the selected decoded shape signal. As a result, the reference processing is simplified to decode the encoded shape signal.
Further, the image encoding device according to claim 23 encodes an input image signal including a shape signal indicating a shape of an object and a pixel value signal having information on color and luminance of the object. A pixel value encoding means for encoding the pixel value signal included in the input image signal by reference to a decoded pixel value signal obtained by decoding after the encoding process; and a shape signal included in the input image signal. Shape encoding means for encoding by referring to a decoded shape signal obtained by decoding after encoding processing, a reference pixel value designating signal specifying a decoded pixel value signal referred to by the pixel value encoding means, and the shape Reference shape paper specifying the decoded shape signal referenced by the encoding means And encoding reference specifying signal generating means for generating a positive signal and generating a prediction selection signal containing information indicating a reference method in encoding based on the generated signal. As a result, the pixel value signal encoding means and the shape signal encoding means respectively perform encoding with reference to the selected reference signal.
The picture decoding apparatus according to claim 24 further includes: a coded shape signal obtained by encoding a shape signal indicating a shape of an object included in an image signal, and a pixel value signal having information on color and luminance of the object; A picture decoding apparatus for decoding a coded pixel value signal, comprising: a coded pixel value signal based on information obtained from the predictive selection signal using a prediction selection signal including information indicating a reference method in the coding process A decode reference specific signal for generating a reference pixel value designation signal for designating a decoded pixel value signal to be referred to in the decoding process for a signal; Generation means and the encoded pixel value signal as a processing target, A pixel value decoding means for decoding by referring to a specific decoded pixel value signal on the basis of the reference pixel value designation signal generated by the decoded reference specific signal generating means, and the coded shape signal as a processing target; It is provided with the shape decoding means which decodes with reference to a specific decoding shape signal based on the reference shape designation signal produced | generated in the specific signal generation means. As a result, the pixel value signal decoding means and the shape signal decoding means each perform decoding with reference to the selected reference signal.
Further, the image coding program recording medium according to claim 25 includes an image coding program for encoding an input image signal including a shape signal representing the shape of an object and a pixel value signal having information on the color and luminance of the object. A recorded image encoding program recording medium, comprising: a pixel value encoding step of encoding a pixel value signal included in the input image signal as a processing target with reference to a decoded pixel value signal decoded after an encoding process; A shape encoding step of encoding a shape signal included in the signal as a processing target with reference to a decoded shape signal after decoding, and a reference pixel specifying a decoded pixel value signal referred to in the pixel value encoding step. In the value specifying signal and the shape coding step A coded reference specific signal generation step of generating a reference shape designation signal specifying a reference shape signal to be referred to, and generating a prediction selection signal including information indicating a reference method in coding based on the generated signal; The picture coding program is recorded. Accordingly, by executing the image coding program in a computer system or the like, in the pixel value signal encoding step and the shape signal encoding step, the encoding process involving the reference of the selected reference signal is executed.
The picture decoding program recording medium according to claim 26 is a coded shape signal obtained by encoding a shape signal indicating the shape of an object included in an image signal and a pixel value signal having information on the color and luminance of the object. And a picture decoding program recording medium on which a picture decoding program for decoding a coded pixel value signal is recorded, the prediction decoding signal being obtained from the prediction selection signal using a prediction selection signal including information indicating a reference method in a coding process. Based on the information, a reference pixel value specifying signal specifying a decoded pixel value signal to be referred to in the decoding process relating to the encoded pixel value signal, and a reference shape specifying the decoded shape signal to be referred to in the decoding process relating to the encoded shape signal. Decode reference specific signal to generate a specified signal A pixel value decoding step of performing a decoding process by referring to a specific decoded pixel value signal on the basis of a reference step and a reference pixel value designation signal generated in the decoding reference specific signal generation step by using the generation step and the encoded pixel value signal as a processing target. And a shape decoding step of performing decoding processing with reference to a specific decoded shape signal based on the reference shape designation signal generated in the decoded reference specific signal generation step by using the coded shape signal as a processing target. It is recorded. As a result, by executing the image coding program in a computer system or the like, in the pixel value signal decoding step and the shape signal decoding step, decoding processing with appropriate reference is executed.
(Example 1)
In the picture coding method and the picture coding apparatus according to the first embodiment of the present invention, the coding efficiency is improved by switching the reference signal for each of the pixel value signal and the shape signal.
Fig. 1 is a block diagram showing the structure of the picture coding apparatus according to the first embodiment. As shown in the drawing, the picture coding apparatus according to the first embodiment includes a subtracter 101, an encoder (for pixel value signals) 102, a decoder (for pixel value signals) 103, and an adder 104. ), First switch circuit 105, second switch circuit 106, memory (1 for decoding pixel value signal storage) 107, memory (2 for decoding pixel value signal storage) 108, average value calculator 109 ), Prediction converter 110, encoder (for shape signal) 111, decoder (for shape signal) 112, third switch circuit 113, fourth switch circuit 114, memory (for decoded shape signal storage) 1) 115 and a memory (2 for decoded shape signal storage) 116 are provided.
In the same figure, the subtractor 101 calculates a difference between an input pixel value signal S151 which is a device input of the image coding apparatus and a reference pixel value signal S155 output from the second switch circuit 106, which will be described later. Generate the value signal S152. The encoder (for pixel value signal) 102 compressively encodes the differential pixel value signal S152 to generate an encoded pixel value signal S153. The decoder (for a pixel value signal) 103 performs a decoding process which is a reverse process of the encoding process on the encoded pixel value signal S153, and generates an encoded decoded pixel value signal S154. The adder 104 adds the encoded decoded pixel value signal S154 and the reference pixel value signal S155 output from the second switch circuit 106 to generate a decoded pixel value signal S156.
The first switch circuit 105 switches the output destination of the decoded pixel value signal S156 in response to the decoded pixel value switching signal S171 input from the predictive converter 110. By switching of the first switch circuit 105, the decoded pixel value signal S156 is either input to the memory 107 or the memory 108, is maintained, or is not input to any of the memories. .
The second switch circuit 106 selects a signal to be used as the reference pixel value signal S155 in response to the reference pixel value switching signal S172 input from the prediction converter 110. By the selection of the second switch circuit 106, the first storage decoded pixel value signal S157 held in the memory 107, the second storage decoded pixel value signal S158 held in the memory 108, and the average value calculator 109. The average decoded pixel value signal S159 obtained by the ") or a predetermined value is used as the reference pixel value signal. Here, the predetermined value is assumed to be fixed pixel data used when the encoder 102 performs intra-frame encoding. The selected reference pixel value signal S155 is output to the subtractor 101 and the adder 104.
The memories 107 and 108 store the decoded pixel value signal S156 input from the first switch circuit 105 in units of frames. The average value calculator 109 inputs the decoded pixel value signals of temporally different frames held in the memories 107 and 108 by switching the first switch circuit 105, obtains the average values thereof, An average decoded pixel value signal S159 is generated. In the first embodiment, the decoded pixel value signal stored in the memory 107 and the memory 108 is a pre-time decoded pixel value signal obtained from a pixel value signal located in time series before the pixel value signal to be encoded. , And is controlled so as to be one of a post-time decoded pixel value signal obtained from a pixel value signal located later in time than the pixel value signal to be encoded.
Subtractor 101, Encoder 102, Decoder 103, Adder 104, Average Calculator 109, Memory 107, Memory 108, First Switch Circuit 105, and Second Switch Circuit 106 functions as pixel value encoding means for encoding an input pixel value signal with reference to the decoded pixel value signal.
The predictive converter 110 outputs the decoded pixel value switching signal S171, the reference pixel value switching signal S172, the decoded shape switching signal S173, and the reference shape switching signal S174, which are control signals, to the first to fourth switch circuits. Each switch circuit controls switching of the output destination of the decoded pixel value signal, the selection of the reference pixel value signal, the output destination of the decoded shape signal, and the selection of the reference shape signal. And encoding the output result of the reference pixel value switch signal used as the reference pixel value designation signal specifying the reference pixel value signal and the reference shape switch signal used as the reference shape designation signal specifying the reference shape signal. It functions as encoding reference specific signal generating means for generating the prediction selection signal S175 and outputting it to notify the decoding apparatus.
The encoder (for shape signal) 111 performs a compression encoding process with reference to the reference shape signal S166 output from the fourth switch circuit 114 to be described later with respect to the input shape signal S161 which is the device input of the image coding apparatus, thereby encoding the encoding. The shape signal S162 is generated. The decoder (for shape signal) 112 performs decoding processing which is a reverse process of the encoding process with reference to the reference shape signal S166 output from the fourth switch circuit 114 with respect to the coded shape signal S162, thereby decoded shape signal S163. Create
The third switch circuit 113 switches the output destination of the decoded shape signal S163 in response to the decoded shape change signal S173 input from the predictive switch 110. By switching of the third switch circuit 113, the decoded shape signal S163 is either inputted to the memory 115 or the memory 116 and held or not input to either of the memories.
The fourth switch circuit 114 selects a signal to be used as the reference shape signal S166 in response to the reference shape switching signal S174 input from the prediction converter 110. By the selection of the fourth switch circuit 114, either the first memory decoded shape signal S164 held in the memory 115, the second memory decoded shape signal S165 held in the memory 116, or a predetermined value. Is used as the reference shape signal. The selected reference shape signal S166 is output to the encoder 111 and the decoder 112.
The memories 115 and 116 store the decoded shape signal S163 input from the third switch circuit 113 in units of frames. In the first embodiment, the decoded shape signals stored in the memory 115 and the memory 116 are the display angle decoded shape signals obtained from shape signals located in time series before the shape signals to be encoded, and the shape signals to be encoded. It is controlled so as to be any one of the rear-view decoded shape signals obtained from the shape signals located later in time series.
The encoder 111, the decoder 112, the memory 115 and 116, the third switch circuit 113 and the fourth switch circuit 114 are shape coding means for encoding a shape signal with reference to the decoded shape signal. Function as.
FIG. 2 is a diagram for explaining encoding of shape signals in the picture coding apparatus according to the first embodiment. The operation of the picture coding apparatus according to the first embodiment will be described below with reference to FIGS. 1 and 2.
When the input pixel value signal S151 and the input shape signal S161, which are device inputs of the picture coding apparatus according to the first embodiment, are input to the apparatus, the input pixel value signal S151 is input to the subtractor 101, and the input shape signal S161 is the encoder ( To a shape signal).
In the subtractor 101, the input pixel value signal S151 and the reference pixel value signal S155 output from the second switch circuit 106 are input, and the differential pixel value signal S152 obtained by the subtraction process is output to the encoder 102. do. The encoder 102 performs a predetermined compression encoding process on the differential pixel value signal S152 to generate an encoded pixel value signal S153. The encoded pixel value signal S153 becomes part of the device output of the picture coding apparatus according to the first embodiment and is also input to the decoder 103. The decoder 103 performs the decoding process which is the inverse process of the encoding process in the encoder 102 with respect to the input encoding pixel value signal S153, and produces | generates the encoded decoding pixel value signal S154. The encoded decoded pixel value signal S154 is output to the adder 104.
In the adder 104, the encoded decoded pixel value signal S154 and the reference pixel value signal S155 output from the second switch circuit 106 are input, and the decoded pixel value signal S156 obtained by the addition process is the first switch circuit ( Output to 105).
The first switch circuit 105 outputs the input decoded pixel value signal S156 to the memory 107 or the memory 108 in accordance with the decoded pixel value switching signal S171 output from the prediction converter 110. In the memory 107 and the memory 108, the input decoded pixel value signal S156 is stored in units of frames. When the decoding pixel value switching signal S171 instructs not to hold the decoding pixel value signal S156, the first switch circuit 105 discards the decoding pixel value signal S156 and does not output it to either memory.
The prediction converter 110 is, in principle, a memory different from the memory just outputted from the first switch circuit 105 so that the decoded pixel value signal S156 is alternately output to the memory 107 and the memory 108. Is instructed in accordance with the decoding pixel value switching signal S171 to output the decoding pixel value signal S156. If the decoded pixel value signal S156 is a signal that is not referred to in the encoding process, the decoded pixel value signal S171 is instructed to discard the decoded pixel value signal S156.
The decoded pixel value signal S156 input to the memory 107 or the memory 108 is held as the first memory decoded pixel value signal S157 and the second memory decoded pixel value signal S158, respectively. The first storage decoded pixel value signal S157 and the second storage decoded pixel value signal S158 are input to the average value calculator 109, and the average value calculator 109 obtains the average of both to obtain the average decoded pixel value signal S159. Create
According to the reference pixel value switching signal S172 from the prediction converter 110, the second switch circuit 106 determines the predetermined value, the first storage decoding pixel value signal S157, the second storage decoding pixel value signal S158, or the average decoding pixel. Any one of the value signals S159 is selected and the selected signal is output to the subtractor 101 and the adder 104 as the reference pixel value signal S155.
The switching instruction to the second switch circuit 106, using the reference pixel value switching signal S172 from the prediction converter 110, is executed as follows. If the encoding object subjected to the encoding process in the encoder 102 is an I frame, encoding with reference processing is not performed, and the second switch circuit 106 instructs the predetermined value to be selected. As a result, the predetermined value used for the intra-frame encoding is output as the reference pixel value signal S155.
When the encoding target in the encoder 102 is a P frame, the prediction switcher 110 is the first one of the first storage decoded pixel value signal S157 or the second storage decoded pixel value signal S158 in time series than the encoding target. Instruct the second switch circuit 106 to be selected.
When the encoding target in the encoder 102 is a B frame, the predictive converter 110 may select any one of the first storage decoded pixel value signal S157, the second storage decoded pixel value signal S158, or the average decoded pixel value signal S159. Instructs to be selected. In the first embodiment, the predictive converter 110 selects that the difference acquired in the subtractor 101 is minimized in the selectable range. Accordingly, the size of the motion detection error in the pixel value signal is minimized as a reference image among the images obtained by the display angle of the display object than the encoding target image, the image of the rear view angle than the encoding target image, or both. To be chosen.
When the encoding target is a P frame or a B frame, either intra frame encoding or inter frame encoding can be performed. In the prediction converter 110, intra frame encoding is selected according to all conditions. It is also possible to instruct to output a predetermined value.
The above-described encoding process for the input pixel value signal S151 is the same as in the case of performing intraframe encoding and interframe encoding according to the prior art. In particular, in the encoding process in the case of a B frame, the encoding efficiency is improved by selecting from a plurality of reference candidates.
On the other hand, in the image encoding device according to the first embodiment, the input shape signal S161 serving as the device input is input to the encoder (for shape signal) 111, and the encoder 111 performs compression encoding processing. This compression encoding process is performed with reference to the decoded shape signal S166 output from the fourth switch circuit 114 described later. From the encoder 111, the coded shape signal S162 generated by the encoding process is output as part of the device output of the image encoder, and is also input to the decoder (for the shape signal) 112.
The decoder 112 performs decoding processing which is an inverse process of the encoding processing in the encoder 111 with respect to the input encoded shape signal S162, and generates the decoded shape signal S163. This decoding process is performed with reference to the reference shape signal S166 output from the fourth switch circuit 114.
The decoded shape signal S163 is output to the third switch circuit 113. The third switch circuit 113 outputs the inputted decoded shape signal S163 to the memory 115 or the memory 116 in accordance with an instruction of the decoded shape change signal S173 output from the predictive switcher 110. In the memory 115 and the memory 116, the input decoded shape signal S163 is stored in units of frames. The third switch circuit 113 discards the decoded shape signal S163 when it is instructed not to hold the decoded shape signal S163 and does not output it to either memory.
In principle, the predictive converter 110 uses a third switch circuit 113 from a memory different from the memory output immediately before so that the decoded shape signal S163 is alternately output to the memory 115 and the memory 116. An instruction is made according to the decoding shape switching signal S173 so as to output the decoding shape signal S163. If the decoded shape signal S163 is a signal that is not referred to in the encoding process, the decoded shape switch signal S173 is instructed to discard the decoded shape signal S163. The decoding shape signal S163 input to the memory 115 or the memory 116 is held as the first storage decoding shape signal S164 and the second storage decoding shape signal S165, respectively.
The fourth switch circuit 114 selects any one of a predetermined value, the first memory decoded shape signal S164, or the second memory decoded shape signal S165 in accordance with the reference shape change signal S174 from the predictive switcher 110, The selected signal is output to the encoder 111 and the decoder 112 as the reference shape signal S166.
2 is a diagram for explaining an encoding process with reference to a shape signal. In the same figure, Fig.2 (a) is a decoded shape signal of the time t0 obtained by encoding and decoding the shape signal of the time t0 located in time series before the shape signal of the time t1 which is encoding object. 2C is a decoded shape signal at time t2 obtained by encoding and decoding the shape signal at time t2 located later in time series than the shape signal at time t1 as the encoding target. As described above, the shape signals that are binary information are obtained by referring to information that is close in time, or by obtaining an average of a plurality of pieces of information located before and after in time series. It is not always possible to improve the coding efficiency. However, in some cases, processing based on temporal correlation is effective.
As shown in FIG. 2, the shape signal of the image at time t1 as the encoding target is partly represented by the shape signal of the decoded image at display angle t0 shown in FIG. 2A, or in FIG. 2C. It is supposed to coincide with the shape signal of the decoded image of the rear view angle t2 shown. In such a case, it is possible to improve the coding efficiency by generating the predictive shape signals using the decoded shape signals close to the front and rear in these time series. In order to improve the accuracy of prediction, it is preferable to select a decoded shape signal to be used for prediction for each unit of the shape signal to be encoded. Therefore, in the first embodiment, independent of the selection of the reference image in the encoding of the pixel value signal, the reference method is also accompanied in the encoding of the shape signal by selecting the prediction method in the encoding of the shape signal independently. It is to improve the coding efficiency by one process.
In the picture coding apparatus according to the first embodiment, the predictive changer 110 has the minimum number of output bits in the encoder 11l with respect to the selection in the fourth switch circuit 114. It is indicated using a reference shape change signal so as to be output as S166. As a result, in the encoder 111, the intra frame encoding that does not accompany the reference using the reference shape signal S166 that is a predetermined value, or the reference shape signal S166 that is the first or second memory decoded shape signal S164 or S165 is used. Among the inter-frame encodings in which the reference shape signal of the display angle or the rear view angle is referred to, the coding efficiency having the best encoding is performed.
In the encoding processing as described above with respect to the input pixel value signal S151 and the input shape signal S161, the prediction converter 110 decodes the pixel value switching signal S171 and the reference pixel value switching signal for controlling each switch circuit. S172, decoded shape change signal S173, and reference shape change signal S174 are generated and output. The predictive converter 110 further encodes each generated switch signal to generate a predictive selection signal S175. The prediction selection signal S175, together with the encoded pixel value signal S153 and the encoded shape signal S162, becomes an apparatus output of the image encoding apparatus according to the first embodiment and is used in the decoding process.
As described above, according to the picture coding apparatus of the first embodiment, the subtracter 101, the encoder (for the pixel value signal) 102, the decoder (for the pixel value signal) 103, the adder 104, and the first switch circuit ( 105, the second switch circuit 106, the memory 107, 108, the average value calculator 109, the predictive converter 110, the encoder (for shape signals) 111, the decoder (for shape signals) 112, Since the three switch circuit 113, the fourth switch circuit 114, and the memories 115 and 116 are provided, the prediction converter 110 is used for encoding the input pixel value signal S151 in the second switch circuit. By controlling the selection of the reference pixel value signal and the selection of the reference shape signal used for encoding the input shape signal S161 in the fourth switch circuit so as to be independently selected, the input pixel value signal and the input shape signal are selected. In any case, the coding efficiency can be improved. Become.
In the first embodiment, in the control of the fourth switch circuit 114 by the prediction converter 110, the selection is made to instruct the minimum number of output bits in the encoder 111 to be instructed. This is an example and can be set according to the nature of the image to be encoded, the processing capability of the image encoding apparatus, the processing situation, and the like. For example, it is also possible to observe the empty capacity of the transmission buffer in the case of transmitting the encoding result according to the first embodiment, and to control such that the intra-frame encoding is preferentially executed when the empty capacity is large.
(Example 2)
The picture decoding method and the picture decoding apparatus according to the second embodiment of the present invention appropriately decode the coding result obtained by the picture coding process according to the first embodiment.
Fig. 3 is a block diagram showing the structure of the picture decoding apparatus according to the second embodiment. As shown, the image decoding device according to the second embodiment includes a decoder (for pixel value signal) 303, an adder 304, a first switch circuit 305, a second switch circuit 306, and a memory (decoding). Pixel value signal storage 1) 307, memory (decoded pixel value signal storage 2) 308, average value calculator 309, decoder (for shape signal) 312, third switch circuit 313, 4 switch circuit 314, memory (for decoded shape signal storage 1) 315, memory (for decoded shape signal storage 2) 316, sequencing memory (for pixel value signal) 361, sequential An array memory (for shape signals) 362 and a predictive converter 370.
In the same figure, the decoder (for the pixel value signal) 303, the adder 304, the first switch circuit 305, the second switch circuit 306, the memories 307 and 308, and the average value calculator 309 The same as those of (103 to 109) in the first embodiment, it functions as pixel value decoding means for decoding the input encoded pixel value signal with reference to the decoded reference pixel value signal. The decoder (for shape signal) 312, the third switch circuit 313, the fourth switch circuit 314, and the memories 315 and 316 are the same as those of (112 to 116) in the first embodiment and are decoded. It functions as a shape decoding means which decodes an input encoded shape signal with reference to the referred reference shape signal.
The sequential memories 361 and 362 hold the decoding result for the necessary sequential arrangement. As described with reference to FIG. 14, when the encoding process accompanied by the bidirectional reference is performed in the encoding process, the image which is later in time is subjected to the encoding process first. Therefore, in the decoding process, if the inputted encoding result is simply decoded and outputted in the input order, the decoding result equivalent to the original image may not be obtained. Therefore, it is retained in the sequential memory once and read in the correct order. To print.
The prediction converter 370 decodes the input prediction selection signal, obtains a control signal for each switch circuit output from the prediction converter 110 (FIG. 1) in Example 1, and based on this, By outputting a switching signal to the switch circuit, it functions as a decoding reference specific signal generating means for indicating a reference signal in pixel value signal decoding and shape signal decoding.
The operation of the picture decoding apparatus according to the second embodiment configured as described above will be described below.
The input decoding pixel value signal S353, the input encoding shape signal S363, and the input prediction selection signal S375 are input to the image decoding device according to the second embodiment. The input coded pixel value signal S353, the input coded shape signal S363, and the input prediction select signal S375 are the coded pixel value signal S153, the coded shape signal S162, and the predictive selection signal S175, which are device outputs of the image coding apparatus according to the first embodiment. Each signal corresponds to. In the picture decoding apparatus according to the second embodiment, the input coded pixel value signal S353 is input to a decoder (for pixel value signal) 303, and the input coded shape signal S363 is input to a decoder (for shape signal) 312. The prediction selection signal S375 is input to the prediction converter 370, respectively.
The prediction switching unit 370 performs decoding processing on the input prediction selection signal S375 to acquire one of a decoded pixel value switching signal, a reference pixel value switching signal, a decoded shape switching signal, and a reference shape switching signal. The prediction converter 370 outputs the decoded pixel value switching signal S371, the reference pixel value switching signal S372, the decoded shape switching signal S373, and the reference shape switching signal S374 to the first to fourth switch circuits based on the acquired signal.
The decoder (for the pixel value signal) 303 performs a decoding process on the encoded pixel value signal S353, generates an encoded decoded pixel value signal S321, and outputs it to the adder 304. The reference pixel value signal S323 output from the second switch circuit is input to the adder 304, and the encoded decoding pixel value signal S321 and the reference pixel value signal S323 are added to generate the decoded pixel value signal S322. . The decoded pixel value signal S322 is input to and held in the memory for ordering array 361 and also output to the first switch circuit 305.
In the first switch circuit 305, similarly to the first embodiment, the output destination of the decoded pixel value signal S322 is switched in accordance with the decoded pixel value switching signal S371 output from the predictive converter 370. The decoded pixel value signal S322 is input to and maintained in any one memory or not in any memory. In the average value calculator 309, a signal held in the memories 307 and 308 is input, the average value thereof is obtained, and an average decoded pixel value signal S326 is generated.
In the second switch circuit 306, as in the case of the first embodiment, the signal used as the reference pixel value signal S323 is selected in accordance with the reference pixel value switching signal S372 output from the predictive converter 370. In this selection, either the predetermined value, the first storage decoded pixel value signal S324 held in the memory 307, the second storage decoded pixel value signal S325 held in the memory 308, or the average decoded pixel value signal S326. Is output from the second switch circuit 306 to the adder 304 as the reference pixel value signal S323.
As described above, the decoded pixel value switch signal S371 and the reference pixel value switch signal S372 output from the prediction switcher 370 are the same as the signals output by the picture coding apparatus according to the first embodiment. Therefore, by the selection in the first switch circuit 305 as in the first embodiment, the memory in the memory 307 and the memory 308 is executed, and the second switch circuit ( By the selection in 306, the same reference signal as that used in the encoding process is used.
On the other hand, the decoder (for shape signal) 312 decodes the input encoded shape signal S363 using the reference shape signal S332 input from the fourth switch circuit, and generates a decoded shape signal S331. The decoded shape signal S331 is input to and held in the memory 362 for sequential array and also output to the third switch circuit 313. In the third switch circuit 313, as in the case of the first embodiment, the output destination of the decoded shape signal S331 is switched in accordance with the decoded shape change signal S373 output from the predictive switch 370. Then, the decoded shape signal S331 is inputted to and maintained in either memory or not in either memory.
In the fourth switch circuit 314, as in the case of the first embodiment, the signal used as the reference shape signal S332 is selected in accordance with the reference shape switching signal S374 output from the predictive converter 370. In this selection, either the predetermined value, the first memory decoded shape signal S333 held in the memory 315, or the second memory decoded shape signal S334 held in the memory 316 is the fourth as the reference shape signal S332. It is output from the switch circuit 314 to the decoder (for shape signal) 312.
As described above, the decoded shape switching signal S373 and the reference shape switching signal S374 output from the prediction switcher 370 are the same as the signals output by the picture coding apparatus according to the first embodiment. Therefore, by the selection in the third switch circuit 313 as in the first embodiment, the memory in the memory 315 and the memory 316 is executed, and as in the first embodiment, the fourth switch circuit ( By the selection in 314, the same reference signal as that used in the encoding process is used.
The decoded pixel value signal S322 processed using the appropriate reference pixel value signal S323 and the decoded shape signal S331 processed using the appropriate reference shape signal S332 are held in the sequential memory 361 and 362, respectively. As the device output of the picture decoding apparatus, the pixel value decoding result S381 and the shape decoding result S382 are output.
Thus, according to the picture decoding apparatus of the second embodiment, the decoder (for the pixel value signal) 303, the adder 304, the first switch circuit 305, the second switch circuit 306, the memory 307, 308, average value calculator 309, decoder (for shape signal) 312, third switch circuit 313, fourth switch circuit 314, memory 315, 316, sequential memory (for pixel value signal) 361, a sequential memory (for shape signals) 362, and a predictive switcher 370, the control according to the signal obtained by decoding the input predictive selection signal S375 by the predictive switcher 370. By instructing selection of each switch circuit using a signal, both the input coded pixel value signal S353 and the input coded shape signal S363, which have been efficiently encoded in the image coding apparatus of the first embodiment, are appropriately decoded. It becomes possible.
(Example 3)
The picture coding method and the picture coding apparatus according to the third embodiment of the present invention perform control of pixel value signal processing and shape signal processing similarly to the picture coding processing according to the first embodiment.
The configuration of the picture coding apparatus according to the third embodiment is the same as that of the first embodiment, and FIG. 1 is used for description. Also for the operation of the picture coding apparatus according to the third embodiment, the encoding processing for the pixel value signal and the shape signal is performed similarly to the first embodiment.
In the picture coding apparatus according to the third embodiment, the method of generating the prediction selection signal S175 by the prediction converter 110 is different from that in the first embodiment. 4 is a diagram for explaining a code assignment method at the time of generating the prediction selection signal S175 in the picture coding apparatus according to the third embodiment. The generation method of the prediction selection signal S175 by the prediction converter 110 according to the third embodiment will be described below with reference to FIG. 4.
Fig. 4A shows code allocation related to shape signal processing. In FIG. 1, whether the prediction switcher 110 instruct | indicated the 4th switch circuit 114 using the reference shape change signal S174 was "predetermined reference", ie, encoding using a predetermined value. That is, whether the encoding refers to the previous image in time series or the "referential reference", that is, the encoding refers to the later image in time series, the prediction converter 110 may use the symbols "0", "10", Alternatively, "11" is allocated to generate the prediction selection signal S175.
Fig. 4B shows code assignments relating to pixel value signal processing. In FIG. 1, whether the prediction switcher 110 instructs the second switch circuit 106 by using the reference pixel value switching signal S172 is "predetermined value reference", that is, encoding using a predetermined value. Reference ", that is, encoding that refers to the previous picture in time series," referential reference ", that is, encoding that refers to a later picture in time series, or" bilateral reference ", that is, encoding that refers to a picture before and after time series. Correspondingly, the prediction changer 110 assigns code "00", "01", "10", or "11" to generate the prediction selection signal S175.
In any case, if a fixed value is used as a predetermined value here, "predetermined value reference" means intraframe coding.
As described above, according to the picture coding apparatus according to the third embodiment, in the same configuration as that of the picture coding apparatus according to the first embodiment, the control signal used by the prediction converter 110 for the coding process of the input pixel value signal, Corresponding to the control signal used for the encoding process of the shape signal, the prediction selection signal S175 is generated according to a predetermined code assignment, respectively, so that each input signal is efficiently encoded as in the first embodiment, and the reference used during the encoding is used. It is possible to use information indicating the processing in the decoding process so that the appropriate decoding process can be executed.
In addition, the code assignment shown in FIG. 4 is an example, it is possible to use various assignment methods, and it is also possible to allocate the short code length to the thing with a high frequency of appearance, and to aim at reducing the total number of bits.
(Example 4)
The picture coding method and the picture coding apparatus according to the fourth embodiment of the present invention are related to the method of generating the prediction selection signal, similarly to the picture coding process according to the third embodiment.
The configuration of the picture coding apparatus according to the fourth embodiment is the same as that in the first embodiment, and FIG. 1 is used for description. Also for the operation of the picture coding apparatus according to the fourth embodiment, the encoding processing for the pixel value signal and the shape signal is performed similarly to the first embodiment.
In the picture coding apparatus according to the fourth embodiment, the method of generating the prediction selection signal S175 by the prediction converter 110 is different from that in the first embodiment. 5 is a diagram for explaining a code assignment method at the time of generating the prediction selection signal S175 in the picture coding apparatus according to the third embodiment. The method of generating the prediction selection signal S175 by the prediction converter 110 in the fourth embodiment will be described below with reference to FIG. 5.
In the third embodiment, the signal is generated by separating the information on the shape signal processing and the information on the pixel value signal processing. In the fourth embodiment, the code allocation method is determined by combining the two. As shown in Fig. 5, in the fourth embodiment, the shortest code length when "predetermined value reference", "front reference", and "rear reference" is selected in both pixel value signal processing and shape signal processing. Is assigned, and when "bidirectional reference" is selected in the pixel value signal processing and "front reference" or "rear reference" is selected in the shape signal processing, the next shorter code length is assigned.
As described in the first embodiment, also in the image coding apparatus according to the fourth embodiment, the encoding process of the pixel value signal and the encoding process of the shape signal are controlled independently, but generally in the pixel value signal Correlation is recognized between the selection of the reference signal and the selection of the reference signal in the shape signal. This indicates that when one side has a high correlation with an image that is full in time series and "front reference" is selected, the other side often has the same selection.
Therefore, in the picture coding apparatus according to the fourth embodiment, in generating the prediction selection signal S175, by using the code assignment in consideration of such correlation, the short code length is assigned to the one with a large occurrence frequency. The code length of the prediction selection signal S175 can be reduced, and the overall coding efficiency can be improved more than in the case of "3".
As described above, according to the picture coding apparatus of the fourth embodiment, in the same configuration as that of the picture coding apparatus of the first embodiment, the control signal and the input shape signal used by the prediction converter 110 for the coding process of the input pixel value signal Corresponding to the control signal used in the encoding process, the predictive selection signal S175 is generated in accordance with a predetermined code assignment combining the respective selections. Thus, as in the first embodiment, each input signal is efficiently encoded, and The information indicating the reference process used at the time of encoding can be efficiently used as the prediction selection signal.
In addition, similarly to the third embodiment, the code assignment shown in FIG. 5 is an example, and the same effect can be obtained by allocating the code length according to the frequency of appearance, without being limited to this example.
(Example 5)
The picture coding method and the picture coding apparatus according to the fifth embodiment of the present invention are related to the method of generating the prediction selection signal, similarly to the picture coding processing according to the third and fourth embodiments.
The configuration of the picture coding apparatus according to the fifth embodiment is the same as that in the first embodiment, and FIG. 1 is used for description. Also for the operation of the image encoding device according to the fifth embodiment, the encoding process for the pixel value signal and the shape signal is performed similarly to the first embodiment.
In the picture coding apparatus according to the fifth embodiment, the method of generating the prediction selection signal S175 by the prediction converter 110 is different from that in the first embodiment. 6 is a diagram for explaining a code assignment method at the time of generating the prediction selection signal S175 in the picture coding apparatus according to the third embodiment. The generation method of the prediction selection signal S175 by the prediction converter 110 according to the fourth embodiment will be described below with reference to FIG. 6.
FIG. 6A is a code assignment relating to a shape signal encoding process, the contents of which are the same as those in the third embodiment shown in FIG. FIG. 6B shows code assignment for a combination of a shape signal encoding process and a pixel value signal encoding process.
In the fifth embodiment, in the generation of the prediction selection signal S175, the prediction switcher 110 first assigns the code according to Fig. 6A to correspond to the shape signal processing, and then the shape signal processing and the pixel. The code according to Fig. 6B is assigned in correspondence with the combination with the value signal processing.
For example, when it is "front reference" in the process of a shape signal, and "forward reference" in the process of a pixel value signal, the code | symbol "10" is assigned to the code "0" first. On the other hand, when the shape signal is "forward reference" and the pixel value signal is "rear reference", the code "10" is assigned first and the code "100" is assigned next. In FIG. 6B, similarly to FIG. 5, in consideration of the correlation between the shape signal and the pixel value signal, a short code length is assigned when the frequency of appearance is high.
As described above, according to the picture coding apparatus of the fifth embodiment, in the same configuration as that of the picture coding apparatus of the first embodiment, the code assignment corresponding to the control signal first used by the prediction switching unit 110 in the coding process of the input shape signal is performed. Next, code assignment is performed corresponding to the combination of the control signal used in the encoding process of the input shape signal and the input pixel value signal to generate the prediction selection signal S175. Thus, each input signal is efficiently encoded as in the first embodiment. In addition, the information indicating the reference processing used at the time of encoding can be efficiently used as the prediction selection signal.
In addition, similarly to the third and fourth embodiments, the code assignment shown in FIG. 6 is an example, and the same effect can be obtained by allocating the code length according to the frequency of appearance, without being limited to this example.
(Example 6)
The picture decoding method and the picture decoding apparatus according to the sixth embodiment of the present invention appropriately decode the coding result obtained by the picture coding process according to the third embodiment.
The configuration of the picture decoding apparatus according to the sixth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Incidentally, also in the operation of the picture decoding apparatus according to the sixth embodiment, the decoding processing for the pixel value signal and the shape signal is performed similarly to the second embodiment.
In the picture decoding apparatus according to the sixth embodiment, the encoding result outputted by the picture coding apparatus according to the third embodiment is input, and the input prediction selection signal S375 (Fig. 3) is input to the picture decoding apparatus according to the sixth embodiment. As a signal, a signal assigned with code assignment shown in Fig. 4 is input. In the image decoding apparatus according to the sixth embodiment, the prediction converter 370 correctly decodes this to perform decoding processing similar to that of the second embodiment, and to appropriately decode the encoding result according to the third embodiment.
As described above, according to the picture decoding apparatus according to the sixth embodiment, in the same configuration as that of the picture decoding apparatus according to the second embodiment, the encoding result according to the third embodiment is input, and the prediction converter 370 selects the input prediction. Since the signal S375 is decoded, it is possible to appropriately decode the encoding result according to the third embodiment.
(Example 7)
The picture decoding method and the picture decoding apparatus according to the seventh embodiment of the present invention appropriately decode the coding result obtained by the picture coding process according to the fourth embodiment.
The configuration of the picture decoding apparatus according to the seventh embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Incidentally, also in the operation of the picture decoding apparatus according to the seventh embodiment, the decoding processing for the pixel value signal and the shape signal is performed similarly to the second embodiment.
In the picture decoding apparatus according to the seventh embodiment, the encoding result outputted by the picture coding apparatus according to the fourth embodiment is inputted, and the input prediction selection signal S375 (FIG. 3) is input to the picture decoding apparatus according to the seventh embodiment. As a signal, a signal assigned with code assignment shown in Fig. 5 is input. In the image decoding device according to the seventh embodiment, the prediction converter 370 correctly decodes this to perform decoding processing similar to that of the second embodiment, and to appropriately decode the encoding result according to the fourth embodiment.
As described above, according to the picture decoding apparatus according to the seventh embodiment, in the same configuration as that of the picture decoding apparatus according to the second embodiment, the encoding result according to the fourth embodiment is input, and the prediction converter 370 selects the input prediction. Since the signal S375 is decoded, it is possible to appropriately decode the encoding result according to the fourth embodiment.
(Example 8)
The picture decoding method and the picture decoding apparatus according to the eighth embodiment of the present invention appropriately decode the coding result obtained by the picture coding process according to the fifth embodiment.
The configuration of the picture decoding apparatus according to the eighth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Also for the operation of the picture decoding apparatus according to the eighth embodiment, the decoding processing for the pixel value signal and the shape signal is performed similarly to the second embodiment.
In the picture decoding apparatus according to the eighth embodiment, the encoding result outputted by the picture coding apparatus according to the fifth embodiment is input, and the input prediction selection signal S375 (Fig. 3) is input to the picture decoding apparatus according to the eighth embodiment. As a signal, a signal assigned with the code assignment shown in Fig. 6 is input. In the image decoding apparatus according to the eighth embodiment, the prediction converter 370 decodes this correctly, thereby performing the same decoding processing as in the second embodiment, and appropriately decoding the encoding result according to the fifth embodiment.
As described above, according to the picture decoding apparatus according to the eighth embodiment, in the same configuration as that of the picture decoding apparatus according to the second embodiment, the encoding result according to the fifth embodiment is input, and the prediction converter 370 inputs the input prediction selection signal. Since S375 is decoded, it is possible to appropriately decode the encoding result according to the fifth embodiment.
(Example 9)
The picture coding method and the picture coding apparatus according to the ninth embodiment of the present invention perform the same control as those in the first embodiment, but control the pixel value signal and the shape signal using different switching units.
The configuration of the picture coding apparatus according to the ninth embodiment is the same as that in the first embodiment, and FIG. 1 is used for the description. Also for the operation of the picture coding apparatus according to the ninth embodiment, the encoding processing for the pixel value signal and the shape signal is performed similarly to the first embodiment.
In the image coding apparatus according to the ninth embodiment, the output of the control signal by the prediction converter 110 is different in the case of controlling the processing of the pixel value signal and in the case of controlling the processing of the shape signal.
7 is a diagram for explaining a switching unit of control in the ninth embodiment. FIG. 7A is a diagram for explaining reference processing in a pixel value signal. As shown, the pixel value signal for one frame (one screen) is composed of a plurality of blocks (9 in this example) in units of blocks, and the encoding process is performed using this block as a processing unit. do. In the ninth embodiment, the switching unit of the control for the pixel value signal is a block, and each block of the input pixel value signal to be encoded is used in the second switch circuit 106 in FIG. The transition is performed.
In contrast, for the shape signal, one frame is used as a control switching unit. Therefore, the switching in the fourth switch circuit 114 in FIG. 1 is performed for each frame of the input shape signal to be encoded.
In the pixel value signal, as shown in Fig. 7A, by switching the reference image in units of blocks, the prediction accuracy is more likely to be improved than in the case of frames, so that the coding efficiency is generally improved. It becomes possible to plan. In contrast, in the shape signal, the statistical property is significantly different from the pixel value signal, and the prediction accuracy cannot be improved uniformly by switching the prediction image in small units. This means that the shape signal has a great meaning with respect to a signal representing the contour of an object, but a signal outside the contour or a part completely contained within the contour is a meaningless signal, which is almost equally meaningful. It is based on a property different from the pixel value signal comprised.
On the other hand, the code amount of prediction selection signal S175 (FIG. 1) is the same with respect to a pixel value signal and a shape signal, and increases as it switches by a small unit. Therefore, for the shape signal, switching is performed in a unit large enough to not affect the prediction accuracy, so that the coding amount of the prediction selection signal S175 included in the device output can be reduced, so that the overall coding efficiency can be improved. It becomes possible. In particular, in the case of a device that transmits and receives a video, data, or the like by an extremely low bit rate coding such as a shape terminal, the amount of code allocated to the pixel value signal or the shape signal constituting the image is small, so that the prediction selection The influence of the code amount of the signal is relatively large, and the effect of the code amount reduction is great.
As described above, according to the picture coding apparatus of the ninth embodiment, in the same configuration as that of the picture coding apparatus of the first embodiment, the switching unit of the control in the predictive converter 110 is the shape of the pixel value signal for each block. By performing the signal on a frame-by-frame basis, control is performed on a relatively large unit for a shape signal in which the size of the transition is less likely to affect prediction accuracy, thereby reducing the code amount of the prediction selection signal S175, which is the device output, to reduce the overall coding efficiency. It becomes possible to aim at improvement. In particular, it is suitable when the processing is performed at a very low bit rate.
In the ninth embodiment, in the encoding process for the shape signal, the frame is always executed as a switching unit. However, the control in which the switching unit such as the frame and the block is different is used together or selected and executed. It is also possible. When such control is executed, the prediction selection signal S175 serving as the device output may include information of different layers such as frame level information and block level information. The level information may be designated by a reference method, and the block level information may be designated by intra-frame encoding or encoding with reference.
In the ninth embodiment, the shape signal is a control switching unit. However, this is an example, and it is also possible to switch a macroblock unit or a larger number of blocks as a unit. In general, the same effect is obtained by making the switching unit of control different from the pixel value signal and the shape signal, and making the larger unit the switching unit for the shape signal.
(Example 10)
In the image encoding method and the image encoding apparatus according to the tenth embodiment of the present invention, similarly to the ninth embodiment, the pixel value signal and the shape signal are controlled using different switching units.
The configuration of the picture coding apparatus according to the tenth embodiment is the same as that in the first embodiment, and FIG. 1 is used for description. Also for the operation of the picture coding apparatus according to the tenth embodiment, the encoding processing for the pixel value signal and the shape signal is performed similarly to the first embodiment.
In the image coding apparatus according to the tenth embodiment, the output of the control signal by the prediction converter 110 is different in the case of controlling the processing of the pixel value signal and in the case of controlling the processing of the shape signal. In the tenth embodiment, the processing of the pixel value signal is controlled in units of switching units as in the ninth embodiment. The switching unit of control for the processing of the shape signal is different from that of the ninth embodiment.
8 is a diagram for explaining a switching unit of control for shape signal processing in the tenth embodiment. In the same figure, the frames 804 to 807 are decoded shape signals which are located before and after in time series of the shape signals to be encoded. The frames 804 to 807 are shape signals for four frames at the time t1, the time t2, the time t3, and the time t4. In FIG. 1, two frames are stored in the memories 115 and 116. In the tenth embodiment, the shape signal for one frame to be processed includes three slices. For example, the frame 807 includes slices 8071 to 8073.
The slice 801 is a slice included in the shape signal frame of time te to be encoded. The slice 801 includes a block to be encoded. The control switching for the shape signal in the tenth embodiment is a hierarchical unit composed of two hierarchies of frames and slices. In the tenth embodiment, first, two frames among four frames of the frames 804 to 807 are selected. From the two selected frames, slice 802 and slice 803 at positions corresponding to slice 801 are obtained, respectively. Next, any one of slice 802, slice 803, and a predetermined value is selected to be used as a reference signal.
In FIG. 1, when the predictive switcher 110 instructs the selection using the reference shape change signal S174, and the selection is the slice 802 or the slice 803 in FIG. 8, the memory 115 is used. Or data of the corresponding part from the memory 116 is read out and used as the reference shape signal S166.
As described above, according to the picture coding apparatus of the tenth embodiment, in the same configuration as that of the picture coding apparatus of the first embodiment, the switching unit of the control in the predictive converter 110 is the shape of each pixel for the pixel value signal. By controlling the signal in hierarchical units of frames in large blocks and slices in small blocks, control is performed on relatively large units of shape signals in which the magnitude of the transition does not affect prediction accuracy. In this way, it is possible to reduce the code amount of the prediction selection signal S175 that is the device output and to improve the overall coding efficiency. It is especially suitable when the processing is performed at a very low bit rate.
Also in the tenth embodiment, similarly to the ninth embodiment, it is possible to use different control in which switching units (hierarchical units) are used together or to select and execute appropriately, and the prediction selection signal includes a plurality of levels of information. It is also possible to make it.
In addition, in Example 9 and 10, although all showed about the switching unit in the process of a shape signal, also in the process of a pixel value signal, it is possible to change the control switching unit, and if it does not switch for every block, Not not.
(Example 11)
The picture decoding method and the picture decoding apparatus according to the eleventh embodiment of the present invention appropriately decode the encoding result obtained by the picture coding process according to the ninth embodiment.
The structure of the picture decoding apparatus according to the eleventh embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Incidentally, also in the operation of the picture decoding apparatus according to the eleventh embodiment, the decoding processing for the pixel value signal and the shape signal is performed similarly to the second embodiment.
In the image decoding device according to the eleventh embodiment, the encoding result outputted by the image encoding device according to the ninth embodiment is input. As described in the ninth embodiment, a block is assigned to a shape signal for the pixel value signal. For the above, the encoding result obtained by the encoding process using the frame as the control switching unit is input. Therefore, in the eleventh embodiment, the prediction converter 370 (FIG. 3) correspondingly outputs a control signal using an appropriate switching unit, thereby accurately decoding the encoding result according to the ninth embodiment. It becomes possible.
As described above, according to the image decoding apparatus according to the eleventh embodiment, in the same configuration as that of the image decoding apparatus according to the second embodiment, the encoding result according to the ninth embodiment is input, and control is performed by the same units as in the ninth embodiment. Since switching is performed, it is possible to appropriately decode the encoding result according to the ninth embodiment.
(Example 12)
The picture decoding method and the picture decoding apparatus according to the twelfth embodiment of the present invention suitably decode the coding result obtained by the picture coding process according to the tenth embodiment.
The configuration of the picture decoding apparatus according to the twelfth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Also for the operation of the picture decoding apparatus according to the twelfth embodiment, the decoding processing for the pixel value signal and the shape signal is performed similarly to the second embodiment.
In the picture decoding apparatus according to the twelfth embodiment, the encoding result outputted by the picture coding apparatus according to the tenth embodiment is input. As described in the tenth embodiment, a hierarchical unit comprising a frame and a slice for a shape signal The encoding result obtained by the encoding process using as a switching unit of control is input. Therefore, in the twelfth embodiment, the prediction converter 370 (FIG. 3) correspondingly outputs the control signal using the appropriate switching unit, so that the decoding result of the tenth embodiment can be correctly decoded. It becomes possible.
As described above, according to the picture decoding apparatus according to the twelfth embodiment, in the same configuration as that of the picture decoding apparatus according to the second embodiment, the encoding result according to the tenth embodiment is input, and the hierarchical unit as in the tenth embodiment is used. Since the control is switched, the coding result according to the tenth embodiment can be appropriately decoded.
(Example 13)
The picture coding method and the picture coding apparatus according to the thirteenth embodiment of the present invention perform the same control as those in the first embodiment, but differ in the method of selecting a reference signal in the coding of the shape signal.
The configuration of the picture coding apparatus according to the thirteenth embodiment is the same as that of the first embodiment, and FIG. 1 is used for description. The operation during the encoding process in the image encoding device according to the thirteenth embodiment will be described below.
In the picture coding apparatus according to the thirteenth embodiment, the control method for reference shape signal selection using the reference shape change signal S174 by the prediction switcher 110 is different from that in the first embodiment.
In the first embodiment, as to the reference shape signal, which of the predetermined value, the time-series decoded shape signal (pre-time) or the time-delayed (post-view angle) decoded shape signal is selected among these, It was decided that the number of output bits from the encoder (for shape signal) 111 decreases. On the other hand, in the thirteenth embodiment, when performing inter-frame encoding, the difference between the time of the shape signal to be encoded, the display angle, and the back time is compared to use the decoded shape signal having the smaller difference. will be.
In addition, in Example 1, although the prediction selection signal used as an apparatus output was obtained by encoding all the switching signals output from the prediction converter, it is also possible to use time information etc. as information which shows a reference method. In 13, information indicating the time is included in the prediction selection signal without encoding processing.
9 is a diagram for explaining the image coding process in the thirteenth embodiment. FIG. 9A shows the encoding of the pixel value signal and is the same as FIG. 14 used for the description of the prior art. FIG. 9B shows the encoding of the shape signal corresponding to FIG. 9A. In the figure, the frames 910 to 916 are shape signals corresponding to the pixel value signals 900 to 906 of one frame, respectively. In the figure, "I", "P", "B", and the arrow indicate the coding method and reference relationship similarly to FIG. In the drawing, t0 to t6 indicate the time of each frame.
The pixel value signal input to the picture coding apparatus of the thirteenth embodiment is executed in the same manner as the coding according to the prior art shown in FIG. In the pixel value signal shown in FIG. 9A, for a frame 901 that is, for example, a B frame, an I frame 900 positioned before in time series and a P frame 903 positioned later in time series are included. As described above, it is possible to improve the prediction accuracy by selecting one of the display angle data and the rear view data, or by using both, for example, by obtaining and using an average value, as described above. It is possible. On the other hand, in the shape signal coding process, the effect of referring to both front and rear is not necessarily large, and according to the thirteenth embodiment, any one of the shape signals is referred to.
For example, for the shape signal 911 corresponding to the frame 901, the difference between the time t1 and the time t0 is compared with the difference between the time t1 and the time t3, and the frame having the smaller difference is used as the reference signal. Here, since the difference with time t0 is small, the frame 900 is referred to. The same applies to other reference relationships.
FIG. 10 is a flowchart showing a processing procedure of encoding processing for a pixel value signal and a shape signal constituting an image signal of a B frame in the image encoding method of the thirteenth embodiment. The processing for the frame 901 and the shape signal 911 of FIG. 9A will be described below in accordance with the flowchart of FIG. 10.
In step 101, the time T0 of the image to be encoded, the pixel value signal B0 constituting the encoding target image, and the shape signal b0 are obtained. In Fig. 9, T0 is t1, the pixel value signal B0 is the frame 901 of Fig. 9A, and the shape signal is 911 of Fig. 9B. In step 102, in the encoding process for the pixel value signal B0, the times T1 and T2 of the pixel value signals P1 and P2 used as reference signals are obtained. As shown in Fig. 9A, the frame 901 refers to the frame 900 and the frame 903, where T1 is t0 and T2 is t3.
In step 103, the difference between T0 acquired in step 101 and T1 and T2 obtained in step 102 is obtained, and the magnitude of the absolute value is compared. Then, step 104 or step 105 is executed according to the comparison result. In Fig. 9, since the time interval of t1 and t0 is smaller than the time interval of t0 and t3, step 104 is executed here.
In step 104, the shape signal b0 to be encoded is encoded by referring to the shape signal p1 corresponding to the time T1. In Fig. 9, since the shape signal corresponding to the time t0 at the time T1 is the signal 910, the shape signal 911 is encoded with reference to the signal 910. In step 106, the encoded shape signal which is the encoding result is output.
In step 107, the pixel value signal B0 is encoded by referring to the pixel value signals P1 and P2. As shown in FIG. 9A, the frame 901 is encoded by referring to the frame 900 and the frame 903. In step 108, the encoded pixel value signal is output as the encoding result, and the encoding process for the image signal of the frame is finished.
When the frame 902 of the pixel value signal and the corresponding shape signal 912 of Fig. 9A are the encoding processing targets, step 105 is executed in the determination of step 103. In this case, the shape signal 912 is encoded with reference to the signal 913.
In the processing sequence shown in the flowchart of FIG. 10, as shown in FIG. 9B, the shape signal corresponding to the B frame is located closer to each other in time among the signals located before and after in time series. The encoding process is performed by referring to one signal.
FIG. 11 is a flowchart showing a procedure of image coding processing control by the predictive converter 110 (FIG. 1) of the image coding apparatus according to the thirteenth embodiment. The control in the thirteenth embodiment will be described below in accordance with the flowchart of FIG. 11.
When the pixel value signal for one frame and the corresponding shape signal are input, the processing procedure shown in FIG. 11 is started. First, in step 1101, it is determined whether or not the input image data to be encoded is a B frame. do. If it was not the B frame here, the process proceeds to step 1110, and then it is determined whether or not it is a P frame.
If it was a B frame, the process after step 1102 is executed. First, in step 1102, the prediction switcher 110 performs the pixel value signals P1 and P2 used as reference signals in the encoding process for the time T0 of the image to be encoded and the pixel value signal constituting the image to be encoded. Time T1 and T2 are obtained. In step 1103, the absolute value of the difference between the time T0 and the time T1 and the absolute value of the difference between the time T0 and the time T2 are compared, and according to the result of the comparison, the step 1104 or step 1105 is performed. Is executed.
In Fig. 1, in the memory 115 and the memory 116, a decoded shape signal based on a shape signal corresponding to the time T1 on one side, and a decoded shape signal based on a shape signal corresponding to the time T2 on the other side. Is remembered. As step 1104 or step 1105 is executed, either of the time T1 or the time T2, a decoded shape signal corresponding to the time at which the time interval with the time T0 is smaller is selected, and the shape signal encoding process is performed. To be used. This means that in FIG. 1, the prediction switch 110 outputs the reference shape switching signal S174 to select the fourth switch circuit 114 so as to select the first or second storage decoded shape signal as the reference shape signal S166. By controlling.
Subsequently, in step 1106, the predictive converter 110 controls the selection of the reference signal used in the encoding process of the pixel value signal. A decoded pixel value signal at time T1 is stored in one of the memories 107 and 108 in FIG. 1, and a decoded pixel value signal at time T2 is stored in the other. The average value calculator 109 obtains an average decoded pixel value signal as an average of the first and second stored decoded pixel value signals stored in the memories 107 and 108. The prediction converter 110 outputs the reference pixel value switching signal S172 to the second switch circuit 106 so that the average decoded pixel value signal S159 is output as the reference pixel value signal S155 from the second switch circuit.
As shown in Fig. 9, since the signal of the B frame is not referred to, the prediction converter 110 does not hold the decoded signals based on these in steps 1107 and 1108. To prevent it. In FIG. 1, the first pixel switch signal 105 has a decoded pixel value signal S156 based on the input pixel value signal S151 at time T0, and the third switch circuit 113 has an input shape signal corresponding to time T0. The decoded shape signal S163 based on S161 is input. The prediction converter 110 outputs the decoded pixel value switching signal S171 to the first switch circuit 105 and the decoded shape switching signal S173 to the third switch circuit 113 to thereby decode the decoded pixel value signal S156 and the decoded shape signal. S163 is controlled so as not to be all input to the memory, so that each decoded signal is discarded.
Subsequently, step 1109 is executed. In step 1109, the predictive converter 110 outputs information on the reference encoding of the shape signal as the predictive selection signal S175. That is, when the information indicating the time P1 and P2 is included in the prediction selection signal without encoding processing, the prediction selection signal S175 is output as the device output of the image coding apparatus, and the decoding result is decoded at the time of decoding. By using the information indicating this, the decoding process is executed correctly.
When steps 1102 to 1109 are executed, the image encoding process for the image data of the B frame ends. Next, the control by the prediction converter 110 in the case where the determination of step 1101 is not a B frame and the steps 1102 to 1109 are not executed will be described.
Following step 1101, step 1110 is executed to determine whether or not the input image data is a P frame. If it is not the P frame here, the process proceeds to step 1113 to control the processing for the I frame.
In the case of a P frame, the processes in steps 1111 to 1112 are executed. In step 1111, the prediction switcher 110 outputs the reference shape change signal S174 to the fourth switch circuit 114, thereby outputting either the memory 115 or the decoded shape signal stored in the memory 116. It outputs as reference shape signal S166. The fourth switch circuit 114 selects and outputs the first or second storage decoded shape signal that is located in time series before the shape signal to be encoded. In step 1112, the prediction converter 110 outputs the reference pixel value switching signal S172 to the second switch circuit 106, thereby either the memory 107 or the decoded pixel value signal stored in the memory 108. Is output as a reference pixel value signal S155. The second switch circuit 106 selects and outputs the first or second storage decoded pixel value signals that are located before the pixel value signal to be encoded in time series.
On the other hand, in the case where the determination of step 1110 is not a P frame, steps 1113 to 1114 are executed. In step 1113, the predictive converter 110 instructs the fourth switch circuit 114 to output a predetermined value as the reference shape signal S166 by outputting the reference shape switching signal S174. From the fourth switch circuit 114, a predetermined value set as a fixed value for intra-frame encoding is selected and output. In step 1114, the predictive converter 110 instructs the second switch circuit 106 to output a predetermined value as the reference pixel value signal S155 by outputting the reference pixel value switching signal S172. From the second switch circuit 106, a predetermined value set as a fixed value for intra-frame encoding is selected and output.
Even when steps 1111 to 1112 or 1111 to 1114 are executed, steps 1115 to 1116 are executed after step 1112 or 1114 to store the decoded signal. Control is executed.
As shown in Fig. 9, since the signals of the P frame and the I frame may be referred to, the prediction converter 110 in steps 1115 and 1116 causes the decoded signals based on these to be stored in the memory. Control to maintain. In FIG. 1, the first pixel switch signal 105 has a decoded pixel value signal S156 based on the input pixel value signal S151 at time T0, and the third switch circuit 113 has an input shape signal corresponding to time T0. The decoded shape signal S163 based on S161 is input. The prediction converter 110 outputs the decoded pixel value switching signal S171 to the first switch circuit 105 and the decoded shape switching signal S173 to the third switch circuit 113 to thereby decode the decoded pixel value signal S156 and the decoded shape signal. S163 is controlled so as to be input into the memory on which the decoded signal is not input immediately before, so that each decoded signal is input to and held in the designated memory. If steps 1115 to 1116 are executed and the decoded signal is stored in any one memory, the processing for the input image signal of the P frame or the I frame ends.
As described above, according to the picture coding apparatus according to the thirteenth embodiment, in the configuration similar to that of the picture coding apparatus according to the first embodiment, the prediction converter 110 encodes the input pixel value signal and encodes the input shape signal. Since the respective reference signals are controlled to be executed in the processing, the respective input signals are efficiently encoded in the same manner as in the first embodiment, and the information indicating the reference processing used at the time of the encoding is used in the decoding process to perform the appropriate decoding process. It becomes possible to plan to execute.
(Example 14)
In the picture coding method and the picture coding apparatus according to the fourteenth embodiment of the present invention, similarly to the thirteenth embodiment, a reference method different from the pixel value signal is used in the encoding of the shape signal. The method is different.
The configuration of the picture coding apparatus according to the 14th embodiment is the same as that of the first embodiment, and FIG. 1 is used for description. The operation at the time of encoding processing in the picture coding apparatus according to the 14th embodiment will be described below.
The picture coding apparatus according to the fourteenth embodiment has almost the same operation as in the thirteenth embodiment, but the reference method when the input image signal is a B frame is different from that in the thirteenth embodiment.
In the thirteenth embodiment, as shown in Fig. 9B, for a shape signal corresponding to a pixel value signal of a B frame, any one of a shape signal located before the time series and a shape signal located after the time series is used. One is selected and used as a reference signal. In the selection, the temporal interval between the shape signal to be encoded and the shape signal located before and after is compared to select a smaller one.
In contrast, in the fourteenth embodiment, the shape signal always located in time series is used as the reference signal. In the thirteenth embodiment shown in FIG. 9B, the shape signal 911 is referred to by the shape signal 910, and the shape signal 912 is referred to by the shape signal 913. In Example 14, the shape signal 910 is referred to in either of the shape signal 911 and the shape signal 912. Therefore, as in the thirteenth embodiment, a process for obtaining and comparing the time intervals is not required, and the control is simple. In particular, it is an effective method when the time interval between the frames shown in FIG. 9 is constant or close to a constant.
As described above, according to the picture coding apparatus according to the fourteenth embodiment, in the same configuration as that of the picture coding apparatus according to the first embodiment, the prediction converter 110 encodes the input pixel value signal and codes the input shape signal. Since the respective reference signals are controlled to be executed in the processing, the respective input signals are efficiently encoded in the same manner as in the first embodiment, and the information indicating the reference processing used at the time of the encoding is used in the decoding process to perform the appropriate decoding process. It is possible to implement the control by simple control.
(Example 15)
In the image encoding method and the image encoding apparatus according to the fifteenth embodiment of the present invention, in the encoding of the shape signal, the reference method different from the pixel value signal is used in the encoding of the shape signal, as in the thirteenth embodiment. The method is different.
The configuration of the picture coding apparatus according to the fifteenth embodiment is the same as that in the first embodiment, and FIG. 1 is used for description. The operation during the encoding process in the image encoding device according to the fifteenth embodiment will be described below.
The picture coding apparatus according to the fifteenth embodiment has almost the same operation as that in the thirteenth embodiment, but the reference method when the input image signal is a B frame is different from that in the thirteenth or the fourteenth embodiment.
In the thirteenth embodiment, as shown in Fig. 9B, for a shape signal corresponding to a pixel value signal of a B frame, any one of a shape signal located before the time series and a shape signal located after the time series is used. One is selected and used as a reference signal. In the selection, the temporal interval between the shape signal to be encoded and the shape signal located before and after is compared to select a smaller one. In addition, in the fourteenth embodiment, a shape signal that is always located before time series is used as a reference signal.
In contrast to this, in the fifteenth embodiment, the prediction converter 110 (FIG. 1), in the encoding process of the shape signal, makes a comparison decision and selects a reference method, i.e., the process in the thirteenth embodiment. In the same way as in the fourteenth embodiment, it is determined whether or not to refer to the shape signal positioned before in time series, that is, forward fixation selection, and to instruct. The determination by the prediction converter 110 can be made according to the nature of the input image signal, the situation of the encoding process, or the like.
As described above, according to the picture coding apparatus according to the fifteenth embodiment, in the configuration similar to that of the picture coding apparatus according to the first embodiment, the prediction converter 110 encodes the input pixel value signal and encodes the input shape signal. Since the respective reference methods are controlled to be executed for the processing, corresponding to the characteristics of the input image signal, the situation of the encoding process, and the like, the respective input signals are efficiently encoded in the same manner as in the first embodiment, and used during the encoding. It is possible to use the information indicating the reference process in the decoding process so that the appropriate decoding process can be executed.
(Example 16)
The picture decoding method and the picture decoding apparatus according to the sixteenth embodiment of the present invention appropriately decode the encoding result obtained by the picture coding process according to the thirteenth embodiment.
The configuration of the picture decoding apparatus according to the sixteenth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Also, the decoding processing for the pixel value signal and the shape signal is performed in the same manner as in the second embodiment also for the operation of the image decoding apparatus according to the sixth embodiment, but the input coded signal is obtained by encoding the image signal of the B frame. In this case, the processing in this case is different from the second embodiment.
FIG. 12 is a flowchart showing a processing procedure for an encoded signal obtained by encoding an image signal of a B frame in the image encoding method according to the sixteenth embodiment. The operation of the picture coding apparatus of the sixteenth embodiment will be described below with reference to FIG. 3 according to the flowchart of FIG.
In the picture coding apparatus shown in the thirteenth embodiment, the coded pixel value signal, the coded shape signal, and the prediction selection signal output as the device output are the input coded pixel value signal S353, the input coded shape signal S363, and the input shown in FIG. It is input as an image coded signal including the prediction selection signal S375, and processing starts. First, in step 1201, the prediction converter 370 acquires the input encoded pixel value signal B0 to be decoded and the time T0 of the input encoded shape signal b0. Subsequently, in step 1202, the prediction converter 370 acquires the time T1 and T2 of the decoded pixel value signals P1 and P2 which are referred to in the processing of the input encoded pixel value signal of the B frame. In step 1203, the input encoded shape signal b0 is input to the decoder 312.
In step 1204, prediction converter 370 performs the determination process using the time acquired in steps 1201 to 1202. In this determination process, the absolute value of the difference between time T0, time T1, and T2 is acquired and compared, and it is determined which one is smaller. As a result of the determination, if the absolute value of the difference between T0 and T1 is smaller, step 1205 is executed. If the absolute value of the difference between T0 and T2 is smaller, step 1206 is executed.
When step 1205 is executed, the predictive switcher 370 outputs the reference shape change signal S374 to the fourth switch circuit 314 so that the time of the decoded shape signals stored in the memory 315 or the memory 316 can be obtained. The signal p1 corresponding to T1 is instructed to be output from the fourth switch circuit 314 as the reference shape signal S332. The reference shape signal S332 is input to the decoder 312 from the fourth switch circuit 314. In the decoder 312, the input encoded shape signal b0 input at step 1203 is the reference shape signal S332. Decoding is performed by referring to.
When step 1206 is executed, the processing is almost similar, and the decoded shape signal p2 corresponding to the time T2 is used as the reference shape signal S332, and the input coded shape signal b0 is decoded.
Even when either step 1205 or step 1206 is executed, step 1207 is next executed, and the decoded shape signal S331 obtained by the decoding process is output to the sequential memory 362.
Then, step 1208 is executed, and the input pixel value signal B0 is input to the decoder 303. In the next step 1209, the prediction switcher 370 outputs the reference pixel value switching signal S372 to the second switch circuit 306 based on the information obtained from the input prediction selection signal S375, so that the memory 307 can be used. Alternatively, the control is performed such that the decoded pixel value signal at time T1 or T2 stored in the memory 308 or the average decoded pixel value signal which is the average of both acquired by the average value calculator 309 is used as the reference pixel value signal S323. In the decoder 303, the input pixel value signal B0 input in step 1208 is decoded with reference to the reference pixel value signal S323. In step 1210, the generated decoded pixel value signal S322 is output to the sequential array memory 361, and the processing for the input encoded image signal ends.
As described above, according to the picture decoding apparatus of the sixteenth embodiment, in the same configuration as that of the second embodiment, the prediction switcher 370 controls so that an appropriate reference signal is used for decoding processing of the decoded shape signal. It is possible to appropriately decode the coding result obtained by the picture coding apparatus according to the example 13.
(Example 17)
The picture decoding method and the picture decoding apparatus according to the seventeenth embodiment of the present invention appropriately decode the encoding result obtained by the picture coding process according to the fourteenth embodiment.
The configuration of the picture decoding apparatus according to the seventeenth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. Also for the operation of the picture decoding apparatus according to the seventeenth embodiment, the decoding processing for the pixel value signal and the shape signal is performed almost similarly to the second embodiment, but the input coded signal is obtained by encoding the image signal of the B frame. In this case, the processing in this case is different from the second embodiment.
In this case, the picture decoding apparatus according to the seventeenth embodiment performs the same operations as the device of the sixteenth embodiment, but the method of selecting a reference signal used for decoding processing of the input encoded shape signal is different. In the image decoding apparatus according to the sixteenth embodiment, in the selection, a comparison decision is made so as to use a decoded shape signal having a small time interval, but in the seventeenth embodiment, the input coded signal to be decoded is not subjected to such a comparison decision. The decoded shape signal located earlier in time series is used as the reference shape signal. Therefore, the coding result output by the picture coding apparatus according to the fourteenth embodiment which performed the same reference processing can be appropriately decoded.
As described above, according to the picture decoding apparatus of the seventeenth embodiment, in the same configuration as that of the second embodiment, since the prediction switcher 370 controls so that an appropriate reference signal is used for decoding processing of the decoded shape signal, It is possible to appropriately decode the encoding result obtained by the picture coding apparatus according to the example 14.
(Example 18)
The picture decoding method and the picture decoding apparatus according to the eighteenth embodiment of the present invention appropriately decode the coding result obtained by the picture coding process according to the fifteenth embodiment.
The configuration of the picture decoding apparatus according to the eighteenth embodiment is the same as that of the second embodiment, and FIG. 3 is used for description. In the operation of the picture decoding apparatus according to the eighteenth embodiment, the decoding processing for the pixel value signal and the shape signal is performed in almost the same way as in the second embodiment, but the input coded signal is obtained by encoding an image signal in which the B-frame is encoded. In this case, the processing in this case is different from the second embodiment.
In this case, the picture decoding apparatus according to the eighteenth embodiment performs the same operation as that of the sixteenth and seventeenth embodiments, but the method of selecting a reference signal used for decoding processing of the input encoded shape signal is different. In the image decoding apparatus according to the sixteenth embodiment, in the selection, a comparison decision is made so as to use a decoded shape signal having a small time interval. In the seventeenth embodiment, the comparison decision is made, rather than the input coded signal to be decoded. The decoded shape signal thermally located before was used as the reference shape signal.
In contrast, in the eighteenth embodiment, when the comparison decision selection or the forward fixation selection is performed at the time of the encoding process, it is determined that the comparison decision selection is performed. If it is, the decoding process is performed similarly to the seventeenth embodiment. Whether or not the comparison decision is made can be determined from the information included in the prediction selection signal output by the image coding apparatus according to the fifteenth embodiment. Therefore, the coding result output by the image coding apparatus according to the fifteenth embodiment which performed the same reference processing can be appropriately decoded.
As described above, according to the picture decoding apparatus of the eighteenth embodiment, in the same configuration as that of the second embodiment, the prediction switcher 370 controls so that an appropriate reference signal is used for decoding processing of the decoded shape signal. It is possible to appropriately decode the coding result obtained by the picture coding apparatus according to Example 15.
(Example 19)
The picture coding program recording medium according to the nineteenth embodiment of the present invention records an picture coding program for executing the picture coding method of the present invention.
13 shows a floppy disk which is an example of a program recording medium. The picture coding program recording medium according to the nineteenth embodiment is encoded in such a recording medium according to the picture coding method described in any one of Examples 1, 3 to 5, 9 to 10, and 13 to 15. The picture coding program to be processed is recorded. Therefore, the picture coding program recording medium according to the nineteenth embodiment can be moved, saved, and the like, and the recorded picture coding program can be copied between the recording media. Then, by executing the program in a computer system or the like under the control of a CPU, a DSP or the like, the image coding apparatus shown in each embodiment can be realized.
In addition to the floppy disk shown in the figure, an image encoding program recording medium can be used as long as it can record a program such as an optical disk such as a CD-ROM, a semiconductor storage device such as an IC card, and a tape medium such as a cassette tape.
As described above, the picture coding program recording medium according to the nineteenth embodiment can realize the picture coding method and the picture coding apparatus of the present invention by executing the recorded picture coding program in a computer system or the like. There is an effect that the method can be easily used.
(Example 20)
An image decoding program recording medium according to a twentieth embodiment of the present invention records an image decoding program for executing the image decoding method of the present invention.
The picture coding program recording medium according to the nineteenth embodiment is any of the second, sixth, eighth, eleventh, twelve, and sixteenth embodiments on a recording medium such as another floppy disk shown in FIG. An image decoding program for performing decoding processing is recorded according to the image decoding method shown in FIG. Therefore, the picture decoding program recording medium according to the twenty-first embodiment can be moved, saved, and the like, and the recorded picture decoding program can be copied between recording media. Then, by executing the program in a computer system or the like under the control of a CPU or a DSP, the image decoding apparatuses shown in the embodiments can be realized.
The image decoding program recording medium can be used as long as it can record a program such as an optical disk such as a CD-ROM, a semiconductor storage device such as an IC card, a tape medium such as a cassette tape, and the like, in addition to the floppy disk shown.
As described above, the image decoding program recording medium according to the twentieth embodiment can realize the image decoding method and the image decoding apparatus of the present invention by executing the recorded image decoding program in a computer system or the like. There is an effect that the method can be easily used.
In the image coding processing and the image decoding processing according to the present invention described in the first to the first embodiments, the image signal is described as including a shape signal and a pixel value signal. In some cases, the application can be applied even when the transmittance signal, which is multi-value information indicating the degree to which the target object conceals the background, is included in the replacement of the shape signal or in addition to the shape signal. When the image signal includes the transmittance signal in the replacement of the shape signal, it is applicable by targeting the transmittance signal in the replacement of the shape signal of the present invention. Moreover, when an image signal contains a shape signal, a transmittance signal, and a pixel value signal, it can apply by combining the transmittance signal into either a shape signal or a pixel value signal. Alternatively, the configuration in which the pixel value signal and the shape signal are separately handled can be extended, and the transmittance signal can also be handled separately.
In Examples 1 to 20, in the encoding of image signals, a case in which irreversible encoding with a high compression ratio is used is assumed, and a signal subjected to decoding processing after the encoding process is used as a reference signal. It is possible to use the pixel value signal and the shape signal to be encoded as reference signals. In such a case, in the encoding process, the decoder can be omitted because the input signal is used as the reference signal.
The present invention provides an encoding apparatus and an encoding method capable of efficiently encoding both of the pixel values signal and the image signal including the shape signal as a processing target.

权利要求:
Claims (26)
[1" claim-type="Currently amended] An image encoding method for encoding an input image signal including a shape signal representing a shape of an object and a pixel value signal having information on color and luminance of the object,
A pixel value encoding step of subjecting the pixel value signal (S151 in FIG. 1) included in the input image signal to a processing target, with reference to the decoding pixel value signal (S155 in FIG. 1) obtained by decoding after the encoding process; ,
A shape encoding step of performing encoding processing with reference to the decoded shape signal (S166 of FIG. 1) obtained by decoding processing after the encoding process by using the shape signal (S161 of FIG. 1) included in the input image signal as a processing target;
A reference pixel value designation signal (S172 in FIG. 1) which designates the decoded pixel value signal referred to in the pixel value coding step, and a reference shape designation signal which designates the decoded shape signal referenced in the shape coding step (FIG. 1 S174), and generating a predictive reference specific signal (S175 in FIG. 1) that includes a prediction selection signal (S175 in FIG. 1) that includes information indicating a reference method in encoding based on the generated signal. An image coding method.
[2" claim-type="Currently amended] The method of claim 1,
The shape encoding step,
A display angle decoded shape signal (S164 or S165 in FIG. 1) obtained from a shape signal that is previously located in time series with respect to the shape signal to be processed;
With respect to the shape signal to be processed, the rear-view decoded shape signal (S164 or S165 in FIG. 1) obtained from the shape signal located later in time series is used as the decoded shape signal referred to above. Way.
[3" claim-type="Currently amended] The method of claim 2,
The pixel value encoding step,
A display angle decoded pixel value signal (S157 or S158 in FIG. 1) obtained from a pixel value signal previously located in time series with respect to the pixel value signal to be processed;
Regarding the pixel value signal to be processed, the post-time decoded pixel value signal (S157 or S158 in FIG. 1) obtained from the pixel value signal located later in time series is used as the decoded pixel value signal referred to above. An image coding method.
[4" claim-type="Currently amended] The method of claim 1,
In the coded reference specifying signal generation step, in the generation of the prediction selection signal (S175 in FIG. 1), the reference pixel value designation signal and the reference shape designation signal are integrated to perform an encoding process (FIG. 5). An image coding method.
[5" claim-type="Currently amended] The method of claim 1,
The coded reference specifying signal generating step determines, in the generation of the prediction selection signal, a method for indicating the designation of the referenced decoded pixel value signal corresponding to the method for indicating the designation of the decoded shape signal to be referred to (Fig. 6) The picture coding method characterized by the above-mentioned.
[6" claim-type="Currently amended] The method of claim 1,
In the coded reference specifying signal generating step, the reference decoded pixel value signal is designated for each pixel value switching unit (FIG. 7A), which is a unit of the input pixel value signal, and the unit of the input shape signal. The reference coding signal is specified for each phosphor shape switching unit (Fig. 7 (b)).
[7" claim-type="Currently amended] The method of claim 6,
The picture coding method, wherein the shape switching unit is a frame constituting the input shape signal (Fig. 7 (b)).
[8" claim-type="Currently amended] The method of claim 6,
The switching unit is a large block unit (804 to 807 in Fig. 8) constituting the shape signal to be input, and a small block unit (802 in Fig. 8) constituting the large block unit. 803), which comprises a hierarchical unit.
[9" claim-type="Currently amended] The method of claim 1,
The shape encoding step,
With respect to the shape signal to be processed, the shape signal to be processed is selected from among the display angle decoded shape signal obtained from the shape signal located before and in time series and the rear view decoded shape signal obtained from the shape signal located later in time and time. And a comparison determination step (S103 in FIG. 10) for selecting to be closer in time,
The decoded shape signal selected in the comparison determination step is referred to (S104 or S105 in FIG. 10).
[10" claim-type="Currently amended] The method of claim 1,
The shape encoding step,
A picture angle decoding shape signal obtained from a shape signal which is previously located in time series with respect to the shape signal to be processed, is referred to.
[11" claim-type="Currently amended] The method of claim 1,
The shape encoding step,
With respect to the shape signal to be processed, the shape signal to be processed is selected from among the display angle decoded shape signal obtained from the shape signal located before and in time series and the rear view decoded shape signal obtained from the shape signal located later in time and time. A comparison judgment step of selecting closer to time;
A forward fix step of selecting the display angle decoded shape signal,
And the selected decoded shape signal is referred to in the comparison decision step or the forward fixation step.
[12" claim-type="Currently amended] A picture decoding method for decoding a coded shape signal and a coded pixel value signal obtained by encoding a shape signal indicating the shape of an object and a pixel value signal having information on the color and luminance of the object included in the image signal. To
Based on the information obtained from the prediction selection signal using the prediction selection signal (S375 in FIG. 3) including the information indicating the reference method in the encoding process, a reference is made in the decoding process for the encoded pixel value signal. Generating a reference pixel value designation signal (S372 in FIG. 3) specifying the decoded pixel value signal and a reference shape designation signal (S374 in FIG. 3) specifying the decoded shape signal to be referred to in the decoding process for the coded shape signal. Generating a decoding reference specific signal;
A pixel value decoding step of subjecting the encoded pixel value signal (S353 in FIG. 3) to a processing target, with reference to the decoded pixel value signal (S323 in FIG. 3) specified in the reference specific signal decoding step;
And a shape decoding step of performing the decoding process by referring to the decoded shape signal (S332 in Fig. 3) specified in the reference specific signal decoding step, using the coded shape signal (S363 in Fig. 3) as a processing target. An image decoding method.
[13" claim-type="Currently amended] The method of claim 12,
The shape decoding step,
A display angle decoded shape signal (S333 or S334 in FIG. 3) obtained from a shape signal that is previously located in time series with respect to the coded shape signal to be processed;
The back-view decoded shape signal (S333 or FIG. 3 in FIG. 3) obtained from the shape signal located later in time series with respect to the coded shape signal used as the process object is made into the decoded shape signal referred to above. Decryption method.
[14" claim-type="Currently amended] The method of claim 13,
The pixel value decoding step,
A display angle decoded pixel value signal (S324 or S325 in FIG. 3) obtained from a pixel value signal previously located in time series with respect to the encoded pixel value signal to be processed;
Regarding the encoded pixel value signal to be the processing target, it is assumed that the rear-view decoded pixel value signal (S324 or S325 in FIG. 3) obtained from the pixel value signal located later in time series is the decoded pixel value signal referred to above. An image decoding method characterized by the above-mentioned.
[15" claim-type="Currently amended] The method of claim 12,
In the decoding reference specifying signal generation step, the prediction selection signal is decoded to obtain the reference pixel value designation signal and the reference shape designation signal which are integrated and encoded (FIG. 5) and the reference shape designation signal. .
[16" claim-type="Currently amended] The method of claim 12,
In the decoding reference specifying signal generating step, in the decoding processing of the prediction selection signal, corresponding to the method indicating the designation of the decoded shape signal to be referred to, a method of indicating the designation of the reference decoded pixel value signal is determined ( 6) an image decoding method characterized by the above-mentioned.
[17" claim-type="Currently amended] The method of claim 12,
In the decoding reference specifying signal generation step, the reference decoding pixel value signal is designated for every pixel value switching unit (FIG. 7A) that is a unit of the encoded pixel value signal.
And the reference shape signal is specified for each shape switching unit (Fig. 7 (b)) which is a unit of the coded shape signal.
[18" claim-type="Currently amended] The method of claim 16,
An image decoding method, wherein the shape conversion unit is a frame constituting the encoded shape signal (Fig. 7 (b)).
[19" claim-type="Currently amended] The method of claim 16,
The switching unit includes a large block unit (804 to 807 in Fig. 8) constituting the encoded shape signal and a small block unit (802, 803 in Fig. 8) constituting the large block unit. The picture decoding method characterized in that the hierarchical unit.
[20" claim-type="Currently amended] The method of claim 12,
The shape decoding step,
The coded object to be processed is a display angle decoded shape signal obtained from a shape signal located before the time series with respect to the coded shape signal to be processed, and a post-view decoded shape signal obtained from a shape signal located later in the time series. A comparison decision step (S1204 in FIG. 12) for selecting the shape signal and the closer in time,
The decoded shape signal selected in the comparison determination step is referred to (S1205 or S1206 in FIG. 12).
[21" claim-type="Currently amended] The method of claim 12,
The shape decoding step,
The display decoding method according to the present invention is characterized by referring to a display angle decoded shape signal obtained from a shape signal which is previously located in time series with respect to the encoded shape signal to be processed.
[22" claim-type="Currently amended] The method of claim 12,
The shape decoding step,
The coded object to be processed is a display angle decoded shape signal obtained from a shape signal located before the time series with respect to the coded shape signal to be processed, and a post-view decoded shape signal obtained from a shape signal located later in the time series. A comparison judgment step of selecting the shape signal and the closer one in time;
A forward fix step of selecting the display angle decoded shape signal,
And the selected decoded shape signal is referred to in the comparison decision step or the forward fixation step.
[23" claim-type="Currently amended] A picture coding apparatus for encoding a picture signal indicating a shape of an object and an input picture signal including a pixel value signal having information about a color and brightness of the object.
Pixel value encoding means (101 to 109 in Fig. 1) for encoding processing by referring to the decoded pixel value signal obtained by decoding processing after the encoding processing, using the pixel value signal included in the input image signal as a processing target;
Shape encoding means (111 to 116 in Fig. 1) for encoding processing by referring to the decoded shape signal obtained by decoding processing after the encoding processing, using the shape signal included in the input image signal as a processing target;
A reference pixel value designation signal specifying a decoded pixel value signal referred to by the pixel value encoding means and a reference shape designation signal specifying a decoded shape signal referred to by the shape encoding means, and generated based on the generated signal And encoding reference specifying signal generating means (110 in FIG. 1) for generating a prediction selection signal containing information indicating a reference method in encoding.
[24" claim-type="Currently amended] A picture decoding apparatus for decoding a coded shape signal and a coded pixel value signal obtained by encoding a shape signal indicating the shape of an object and a pixel value signal having information on the color and luminance of the object included in the image signal. To
The decoding pixel value signal to be referred to in the decoding process for the encoded pixel value signal is specified based on the information obtained from the prediction selection signal using a prediction selection signal including information indicating a reference method in the encoding process. Decoding reference specifying signal generating means (370 in FIG. 3) for generating a reference pixel value specifying signal to be referred to and a reference shape specifying signal specifying a decoded shape signal to be referred to in the decoding process on the encoded shape signal;
Pixel value decoding means for performing the decoding process by referring to a specific decoded pixel value signal on the basis of the reference pixel value designation signal generated by the decoded reference specific signal generation means, using the encoded pixel value signal as a processing target (Fig. 3). (303 to 309)),
Shape decoding means for performing the decoding process by referring to the specific decoded shape signal based on the reference shape designation signal generated by the decoded reference specific signal generation means, using the coded shape signal as a processing target ((312 to 316 in Fig. 3). Image coding apparatus comprising a)).
[25" claim-type="Currently amended] An image coding program recording medium which records an image coding program for encoding an input image signal including a shape signal representing a shape of an object and a pixel value signal having information on the color and luminance of the object.
A pixel value encoding step of subjecting a pixel value signal included in the input image signal to a processing target and encoding the reference by referring to the decoded pixel value signal which has been decoded after the encoding process;
A shape encoding step of encoding a shape signal included in the input image signal as a processing target by referring to a decoded shape signal after decoding processing;
A reference pixel value designation signal specifying a decoded pixel value signal to be referred to in the pixel value coding step and a reference shape designation signal to designate a decoded shape signal to be referred to in the shape coding step, An image coded program recording medium (FIG. 13), which records an image coded program including a coded reference specific signal generation step of generating a predictive selection signal including information indicating a reference method in encoding.
[26" claim-type="Currently amended] An image decoding program for decoding the encoded shape signal and the encoded pixel value signal, which are obtained by encoding a shape signal indicating the shape of an object included in the image signal, and a pixel value signal having information on the color and luminance of the object. An image decoding program recording medium having recorded thereon,
The decoding pixel value signal to be referred to in the decoding process for the encoded pixel value signal is specified based on the information obtained from the prediction selection signal using a prediction selection signal including information indicating a reference method in the encoding process. A decoding reference specifying signal generation step of generating a reference pixel value specifying signal to be referred to and a reference shape specifying signal specifying a decoded shape signal to be referred to in the decoding process on the encoded shape signal;
A pixel value decoding step of subjecting the encoded pixel value signal to a processing target and decoding the reference pixel value signal based on the reference pixel value designation signal generated in the decoding reference specific signal generation step;
Recording an image decoding program including a shape decoding step of performing a decoding process by referring to a specific decoded shape signal based on the reference shape designation signal generated in the decoded reference specific signal generation step by using the coded shape signal as a processing target; An image decoding program recording medium (Fig. 13) characterized by the above-mentioned.

类似技术:

---

公开号 | 公开日 | 专利标题

---

JP5580453B2|2014-08-27|Direct mode encoding and decoding apparatus

---

US8873631B2|2014-10-28|Video decoding device, video decoding method, video decoding program, and video decoding integrated circuit

---

TWI444048B|2014-07-01|Fragmented reference in temporal compression for video coding

---

JP4558827B2|2010-10-06|Image data decoding method and computer-readable medium having recorded program therefor

---

US6148028A|2000-11-14|Video coding apparatus and method which codes information indicating whether an intraframe or interframe predictive coding mode is used

---

KR100413153B1|2003-12-31|Picture encoder and picture decoder

---

US6987887B2|2006-01-17|Video coding and video decoding apparatus

---

ES2206358T3|2004-05-16|Video coding procedure for coding signals and texture signs using various modalities.

---

US6633678B2|2003-10-14|Image predictive decoding method, image predictive decoding apparatus, image predictive coding method, image predictive coding apparatus, and data storage media

---

US6381275B1|2002-04-30|Image coding apparatus and image decoding apparatus

---

CN101385334B|2011-09-14|Imaging device and method, recording device and method, and reproduction device and method

---

CN100382603C|2008-04-16|Image coding device and image decoding device

---

US8023754B2|2011-09-20|Image encoding and decoding apparatus, program and method

---

JP2646169B2|1997-08-25|Video compression and decompression methods

---

JP4662636B2|2011-03-30|Improvement of motion estimation and block matching pattern

---

TWI244856B|2005-12-01|Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, video encoding program, and video decoding program

---

AU2002316666B2|2006-11-02|Interpolation of video compression frames

---

JP3863510B2|2006-12-27|Motion vector encoding / decoding method and apparatus

---

JP5155157B2|2013-02-27|Video decoding device

---

US6625215B1|2003-09-23|Methods and apparatus for context-based inter/intra coding mode selection

---

JP4533081B2|2010-08-25|Image encoding apparatus and method

---

US5991453A|1999-11-23|Method of coding/decoding image information

---

US5608458A|1997-03-04|Method and apparatus for a region-based approach to coding a sequence of video images

---

JP3037407B2|2000-04-24|Digital signal processing system

---

KR101375666B1|2014-03-26|Method and apparatus for encoding and decoding multi-view image based on global disparity vector

同族专利:

---

公开号 | 公开日

---

US20010010736A1|2001-08-02|

---

ES2218293T3|2004-11-16|

---

DE69822895D1|2004-05-06|

---

DE69801062D1|2001-08-16|

---

EP1111929B1|2004-03-31|

---

ES2233508T3|2005-06-16|

---

US6487320B2|2002-11-26|

---

EP0855839A1|1998-07-29|

---

CN1199306A|1998-11-18|

---

EP1111931B1|2004-08-11|

---

US6539123B2|2003-03-25|

---

US20010007598A1|2001-07-12|

---

EP1111931A2|2001-06-27|

---

EP1111931A3|2001-08-29|

---

DE69828204T2|2005-12-22|

---

US20010004405A1|2001-06-21|

---

CN1123230C|2003-10-01|

---

DE69828204D1|2005-01-20|

---

EP1111930B1|2004-12-15|

---

EP1111929A3|2001-08-29|

---

DE69825638D1|2004-09-16|

---

TW406514B|2000-09-21|

---

MY120138A|2005-09-30|

---

CN1171461C|2004-10-13|

---

EP0855839B1|2001-07-11|

---

US6088485A|2000-07-11|

---

EP1111930A3|2001-08-29|

---

CN1354598A|2002-06-19|

---

CN1201593C|2005-05-11|

---

KR100266124B1|2000-09-15|

---

US6567560B2|2003-05-20|

---

JPH10271517A|1998-10-09|

---

ES2162688T3|2002-01-01|

---

CN1354599A|2002-06-19|

---

EP1111930A2|2001-06-27|

---

US6263116B1|2001-07-17|

---

DE69822895T2|2005-04-21|

---

DE69801062T2|2001-11-22|

---

EP1111929A2|2001-06-27|

---

JP3223962B2|2001-10-29|

---

DE69825638T2|2005-09-15|

---

ES2225326T3|2005-03-16|

---

CN1165181C|2004-09-01|

---

CN1354600A|2002-06-19|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

法律状态:
1997-01-24|Priority to JP1100097

---

1997-01-24|Priority to JP97-011000

---

1997-12-26|Priority to JP36011697A

---

1997-12-26|Priority to JP97-360116

---

1998-01-24|Application filed by 모리시타요우이치, 마쓰시타덴키산교가부시끼가이샤

---

1998-10-26|Publication of KR19980070825A

---

2000-09-15|Application granted

---

2000-09-15|Publication of KR100266124B1

优先权:

---

申请号 | 申请日 | 专利标题

---

JP1100097|1997-01-24|

---

JP97-011000|1997-01-24|

---

JP36011697A|JP3223962B2|1997-01-24|1997-12-26|Image decoding method|

---

JP97-360116|1997-12-26|